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ABSTRACT 


The Coast Guard enlisted performance evaluation system 
requires a semiannual evaluation of all enlisted personnel 
in the areas of proficiency, leadership, and conduct. The 
stated objective of the system is to differentiate between 
the performance of individuals. The performance evaluation 
marks assigned are intended for such administrative purposes 
as advancement in rate, assignment, and determination of 
the character of service. A Coast Guard-wide sample of 
performance evaluation marks for the period ending 31 December 
1975 and of the records of personnel who participated in the 
March 1976 servicewide examination for advancement was 
analyzed. In an effort to improve upon the quality of 
enlisted performance evaluations, a format and methodology 
for development of a new performance evaluation system that 
will differentiate individual performance as well as aid in 


individual career development through counseling was designed. 
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I. THE NEED FOR A COAST GUARD ENLISTED 
PERFORMANCE EVALUATION SYSTEM 

Organizations have developed and employed formal per- 
formance evaluation systems to satisfy two sets of sometimes 
conflicting needs: those of the organization and those of 
the individual. Organizational needs have been directed 
toward obtaining standardized documentation to facilitate 
systematic and equitable judgments for such administrative 
actions as promotion, transfer, and termination. Individual 
needs have centered on personal recognition and development. 
To satisfy these individual needs each person must be pro- 
vided with information on how seniors assess his or her 
performance, how this performance may be improved, and where 
the individual stands relative to his or her peers. 

The purpose of this study was to analyze how adequately the 
Coast Guard enlisted performance evaluation system satisfies 
the two basic needs and to propose changes if necessary. 
Although the present system has remained virtually unchanged 
since 1961, prior to this study no formal, systematic analysis 
had been conducted. There was neither data available on the 
overall distribution of performance evaluation marks with 
which to compare the results of this study, nor was there 


one location where the current marks of all individuals could 
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be examined. Current performance evaluation marks were 
sampled from the records of the enlisted assignment officers 
in Coast Guard headquarters and from recommendations for 
servicewide examinations maintained by the Coast Guard 
Institute. Though the samples were subsets of the enlisted 
population, they were the best samples available and, in 

the opinion of the authors, were indicative of the actual 
distribution that existed in the Coast Guard for the evalua- 
tion period ending 31 December 1975. 

The present performance evaluation system has been an 
essential part of the Coast Guard's overall personnel 
management program. If the present system has not adequately 
differentiated among the performance of individuals, the 
administrative processes of advancing and assigning enlisted 
personnel may have been severely degraded. As a result, 
the best qualified individuals may not have been selected 
for advancement to senior enlisted, warrant officer, or 
commissioned officer levels. Since our reputation as a 
professional seagoing service has been largely based on the 
competence of senior enlisted personnel who serve on our 
floating units, particularly as officers in charge, the 
impact of incorrect administrative decisions on the service 
may have seriously affected the efficiency and effectiveness 


of the Coast Guard. 
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As a product of this analysis, several shortcomings in 
the present system were revealed. This resulted in the 
development of a methodology for establishing an entirely 
new system designed to adequately satisfy the needs of both 


the organization and the individuals within the organization. 
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IT. ANALYSIS OF THE PRESENT COAST GUARD 
ENLISTED PERFORMANCE EVALUATION SYSTEM 


The system presently employed in the Coast Guard for 


evaluating enlisted personnel performance is outlined in 


the Personnel Manual (CG-207) /Ref. 32/7. The stated objec- 


tive, to differentiate between the performance of individual 


enlisted personnel, was designed to produce performance 


marks that would be used for a myriad of administrative 


purposes. These uses of performance marks as described 


in Chapter 10 of the Personnel Manual include: 


l. 


2. 


a factor in the advancement in rate process 
selection for proficiency pay 

selection to warrant or commissioned status 
selection for special programs and courses of 
instruction 

selection of individuals to be awarded the Good 
Conduct Medal 

determination of the type of discharge 
desirability for reenlistment 

reduction in rate for incompetency 

propriety of early separation by administrative 


discharge 
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One additional use, which is outlined in Chapter 4 of the 
Personnel Manual, is the assignment of enlisted personnel 
to duty stations. The mechanics of the present enlisted 
performance evaluation system is included as Appendix A for 
the benefit of those readers not familiar with the current 
procedures. 

From the objective and uses of the performance marks, 
the authors concluded that the system was designed to satisfy 
the organizational purpose of providing systematic judgments 
and documentation for administrative actions. From analyzing 
the uses as well as the mechanics of the system, the authors 
also concluded that the second purpose of a performance 
evaluation system, that of counseling and development, has 
been virtually ignored in the present system. 

To analyze the present system, information was collected 
from four sources. The first source was a series of 22 
interviews conducted both in the field (including a former 
Chief of the Enlisted Personnel Division and two district 
personnel officers) and at the headquarters level. Personnel 
interviewed at headquarters included the current Chief of 
the Training and Education Division and two of his assistants, 
the current Assistant Chief of the Enlisted Personnel Divi- 
Sion, the Chief of the Enlisted Assignments Branch and two 


of his assistants, and 12 enlisted assignment officers. 
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The purpose of these interviews was to obtain their per- 
ceptions of marks and marking trends, the utility of marks 
assigned under the present system, and to identify problem 
areas along with suggestions for improvement. 

Another source of information was obtained by removing 
all the descriptive phrases from the Enlisted Performance 
Evaluation Worksheet (CG-3788), attached as Appendix B. 
Those terms relating to a particular trait (such as appear- 
ance, petty officer potential, etc.) were grouped, although 
not in the same order as in the original form, and 15 
officers were asked to place these phrases in the appropriate 
category (proficiency, leadership, and conduct) at the 
appropriate level (ranging from "ideal" to "grossly inade- 
quate"). The purpose of this exercise was to determine if 
individuals who had been raters and were prospective raters 
agreed with the rank-order and placement of descriptive 
terms on the current evaluation form. 

Two other sources of data were a sample of performance 
marks obtained from headquarters "request for assignment" 
files and servicewide examination data for advancement in 
rate from the March 1976 servicewides obtained from the 
Coast Guard Institute. The data obtained from both of these 
sources has been explained in further detail later in this 


chapter. 
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A. AN ASSESSMENT OF THE PRESENT SYSTEM'S ABILITY TO 
SATISFY ITS PRIMARY OBJECTIVES 


l. The Sample 
The first step in analyzing the present system was 

to assess the degree to which the primary objective of 
differentiating among the performance of individuals was 
satisfied. A problem was encountered since all performance 
marks have not been collected in any central location. The 
largest collection of current marks that could be located 
were those performance marks submitted to the Central Assign- 
ment Control (CAC) officers in the Enlisted Assignment Branch 
of Coast Guard headquarters on the Enlisted Assignment/Data 
Form (CG-4526). A sample of 2310 sets of marks (a set con- 
sists of a mark for proficiency, leadership, and conduct) 
for the semiannual evaluation period ending 31 December 1975 
was taken. 

A stratified, random sampling ee was employed. 
The sample was stratified by paygrade and an attempt was 
made to capture marks for ten per cent of the total Coast 
Guard population for each specialty or rating within each 
paygrade for rated personnel (paygrades E-4 through E-9). 
This strategy was affected by the fact that for some rates 
and ratings December 1975 marks were not available for ten 


per cent of the total population since not all personnel had 
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an assignment form on file and, in other instances, forms 
on file did not contain marks for the desired period. In 
instances where fewer than ten per cent were available, all 
of the available marks were collected. When greater than 
ten per cent were available, ten per cent of the marks were 
selected at random. Since all enlisted personnel are directed 
to submit assignment forms when advanced and within ten days 
of reporting on board a new unit for permanent assignment 
to duty, all personnel should theoretically have a form on 
file. The reasons that many have not submitted the form 
were unknown. This situation indicated a possible source 
of bias in the sample collected. Additionally, marks were 
collected for only one specific marking period to reduce 
any effect of changes in marking trends over time. This pro- 
cedure resulted in limiting the number of personnel whose 
marks could be analyzed and introduced another possible source 
of bias. 

Since headquarters assigns only personnel with a specialty, 
a limited number of marks was available in headquarters for 
nonrated personnel in paygrade E-3 who had subsequently been 
advanced or were selected for advancement. Since district 
personnel officers assign nonrated personnel without a 
specialty, additional E-2 and E-3 marks were obtained by 


recording all marks available for these paygrades in the 
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Personnel Division of the Third Coast Guard District in New 
York. Once again, for unknown reasons, many personnel did 
not have requests for assignment on file. Furthermore, 
the assumption was made that the collection of marks from 
this one geographic region could be generalized to the entire 
population of nonrated personnel. One additional note- 
worthy point was that no marks were available for personnel 
in paygrade E-1l due to the fact that the overwhelming majority 
of personnel in this paygrade are undergoing recruit training 
and recruits are not assigned performance marks under this 
system. 
23 Analysis of the Sample 

The sample collected was analyzed in several manners. 
First of all, the distribution characteristics were calculated 
for the sample as a whole. This was done to test the hypoth- 
esis that since all evaluations are submitted on the same 
dates, a commanding officer responsible for reviewing the 
marks could be led to believe that a good distribution was 
being obtained since the evaluations for all rates and ratings 
were being reviewed at the same time. Secondly, the marks 
were analyzed by paygrade. Since all individuals are to be 
evaluated relative to others in the same paygrade, this 
analysis was designed to test how well the marks assigned 


under the current system differentiate among the performance 
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of individuals of the same paygrade. One final analysis 
was made to determine if marking trends varied among the 
various communities within the Coast Guard. To conduct 
this analysis the authors divided the rated personnel into 
three communities or categories and then computed the dis- 
tribution for each community. A listing of the specific 
ratings placed in each category has been outlined in 
Appendix C. One problem encountered with the results 
obtained from this portion of the analysis was that in 
several instances the sample size was not large enough to 
enable the authors to confidently conclude that the results 
could be generalized to all persons of that paygrade in that 
community. In these instances, where the number of cases 
was less than thirty, the results have been annotated. 

3. Results and Conclusions 

The specific results of this analysis have been 
included as Appendix D with an overview of the results 
depicted graphically in Figure 1 below. 

The analysis revealed that a mark of 4.0 in conduct 
was almost universal. This result was not surprising since 
the Personnel Manual indicates the evaluation of conduct will 
normally be 4.0. The distribution of marks across all ratings 
and paygrades RER and supported the hypothesis that 


a commanding officer could draw the conclusion that the 
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Figure 1. Graphic Presentation of Mean Performance Marks 


by Paygrade from Appendix D. 
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present system does produce a reasonable distribution when 
all evaluations are viewed at the same time. When examining 
the distribution of proficiency and leadership marks by pay- 
grade, the results indicated that the mean for each paygrade 
differs from the intended average of 3.3. In all cases, as 
paygrade increased, the mean marks also increased. This 
result supported the perception of individuals interviewed 
that marks were inflated with an increase in paygrade. 
Furthermore, the variance in the proficiency and leadership 
marks decreased with increases in paygrade for rated personnel. 
As a result, it is felt that the present evaluation system 
has not adequately differentiated among the performance of 
individuals in more senior paygrades. The analysis of marks 
by communities led to the conclusion that evaluations have 
been more inflated in the aviation community than in the 
other communities. Another conclusion was that the marks 
for proficiency and leadership are highly correlated indi- 
cating that the present system has not been adequately 
measuring two distinct traits or attributes. 

The final conclusion drawn was that enlisted perform- 
ance evaluation marks should be collected in a central loca- 
tion to permit a periodic analysis of the distribution of 
marks. This change would permit a routine assessment of 
whether the primary objective of the evaluation system is 


being satisfied. 
21 





B. AN ANALYSIS OF THE CURRENT USES OF PERFORMANCE MARKS 
The next step in analyzing the present performance 
evaluation system was to examine each of the uses for the 
performance marks and determine how ciel the marks 
contributed to satisfying that use. Responses from the 
interviews conducted revealed that the majority of personnel 
believe advancement in rate and assignments to be the most 
important uses of performance marks. 
|. AAA in Rate 
a. Advancement to Paygrades E-2 and E-3 
Since the Enlisted Performance Evaluation Work- 
sheet (CG-3788) has not been used for evaluating recruits, 
it rarely affects advancement to E-2. For advancement to 
paygrade E-3, the determination of qualification has been 
made by the local command for individuals who have met 
minimum time-in-service requirements, completed a list of 
required practical factors, and satisfactorily passed a 
correspondence course administered through the Coast Guard 
Institute for Seaman or Fireman. Therefore, performance 
marks have played only an indirect role as no minimum per- 
formance levels have been established. 
b. Advancement to Paygrades E-4 through E-9 
In all petty officer grades, advancement has been 


based on a servicewide competition system among individuals 
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who seek advancement to each specific rate. After a man 

has completed the practical factors, a correspondence course 
for the next senior rating, and satisfied the minimum time- 
in-rate requirement, he takes a Coast Guard-wide examination, 
feceloped and scored by the Coast Guard Institute. This 
examination score is combined with factors for performance, 
time-in-service, time-in-rate, and medals and awards for 
computing a final multiple described in detail in Table I. 
This final multiple is used to determine each aa 
position in the rank ordering of all personnel of the same 
paygrade and rating who are competing for advancement. The 
Enlisted Personnel Division of headquarters determines the 
needs of the service for each rate, considering authoriza- 
tion ceilings, and that number are advanced from the rank- 
ordered listings of personnel in the order they appear in 
the listing. 

| While Table I reports a percentage of the total 
multiple that each factor contributes, it should be pointed 
out that these are intended contributions. The actual role 
of each of these factors is dependent upon the degree that 
each factor discriminates one competitor from another. For 
instance, if all competitors for E-9 in the Boatswain's Mate 
rating have performance marks of 4.0, performance marks would 


have no effect in determining the final rank-order of these 
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Table I 


Factors and Maximum Points in the Final Multiple Score 
for Advancement in Rate 


Maximum 
Points 


Factor 


Examination 80 
Score 


Performance 50 
Evaluations 


Time in Service 20 


Time in Paygrade 20 
in Present Rating 


Medals and 10 
Awards 

Final Multiple 180 
Score 


Percentage 
of Total 


Multiple 


44.44 


27.78 


Jean] 


LELE 


5.506 


100.00 
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How Computed 


Exam standard score 


(1) Subtract average 
performance marks 
(average of pro- 
ficiency and lead- 
ership during 
period of eligi- 
bility) from 4.0. 

(2) Multiply by 30. 

(3) Subtract total 
from 50. 


Total months = 12. 
One point credit per 
year with a maximum 
credit given for 20 
years. 


Total months > 6. 
Two point credit per 
year with a maximum 
credit given for 10 
years. 


Various medals with 
different points. 
Point values of each 
medal listed in 
Article 5-C-1 of the 


Personnel Manual. 





competitors. Since the variance of each of the factors 
determines the actual weighting the factor has in deter- 
mining the final ordering, a statistical analysis of the 
factor scores for personnel competing for advancement was 
performed to analyze the true role of performance marks in 
the advancement process. The data analyzed was obtained 
from the Coast Guard Institute and contained the numerical 
values for each of the five factors on all personnel com- 
‘peting for advancement in the March 1976 competition. A 
series of multiple regressions were calculated using the 
Statistical Packages for the Social Sciences /Ref. 297. 
Actual weightings were determined from the amount of variance 
contributed by each factor as determined by the change in the 
squared value of the multiple regression coefficient. 

c. Results and Conclusions - 

While more detailed information by paygrade has 
been provided in Appendix E, Table II presents the actual 
contributions across all paygrades. The results indicate 
that the actual role of the performance factor is considerably 
less than intended. This was primarily due to the small 
variance in performance marks as well as the formula estab- 
lished for computing this factor. Since marks of 3.3 in 
proficiency and leadership in the last evaluation period 


are required as a minimum for recommending an individual to 
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Table II 


Actual Contributions of the Factors in the Final 
Multiple Score for Advancement in Rate 


Intended Actual 
Factor Contribution Contribution 
Examination Score 44.44 39.72 
Performance Evaluations 21.218 152353 
Time in Service 11.11 38.26 
Time in Paygrade in PEEL | IPIS 

Present Rating 

Medals and Awards 5.56 0.56 
Final Multiple Score 100.00 99.82° 


lActual contributions depicted here are an excerpt of 
the material presented in Appendix E. The figures listed 
above were calculated for 2/729 enlisted personnel in pay- 
grades E-3 through E-8 who participated in the March 1976 
servicewide competition for advancement. 


Factor contributions do not sum to 100 due to rounding 
errors. 
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participate in the advancement competition, the formula for 
computing each competitor's performance factor insures that . 
approximately 29 of the 50 points have been awarded to each 
competitor, thereby further reducing the maximum amount of 
variance that could have occurred. 

One important point that should be considered 
is that the examination scores have been standardized so a 
specific amount of variance has been imposed. Performance 
factors, as well as the remaining factors, could also be 
standardized to produce a desired variance which would 
permit each factor to have an actual contribution equivalent 
to the intended contribution. But this would only amount to 
forcing a distribution where one did not naturally exist. 
This approach would really be treating a symptom and ignoring 
the basic illness and therefore has not been recommended. 

A similar analysis for each different competition 
date would probably produce different results due to the change 
in variance caused by the different set of competitors. It 
is strongly recommended that in the future all competitions 
be analyzed to determine the actual basis for selecting per- 
sonnel for advancement and as an indication of when the 
selection for advancement system is in need of revision. 

An analysis of the distribution of performance 


marks from the advancement data was also calculated. The 


27 


results of this analysis have been included as Appendix E. 
The performance marks contained in this data set were an 
average of the proficiency and leadership marks for the 
period of eligibility. The period of eligibility or time 

in present paygrade varies with paygrade and have been listed 


in Table III that follows: 


Table III 


Period of Eligibility by Paygrade 


Examination Paygrade Period of Eligibility 
E-3 to E-4 6 months 
E-4 to E-5 6 months 
E-5 to E-6 12 months 
E-6 to E-7 24 months 
E-7 to E-8 36 months 
E-8 to E-9 24 months 


In all cases the marks for the period of eligibility included 
the December 1975 marks but for the more senior paygrades 
additional marks for previous periods were included. For 
these reasons, as well as for the fact that a minimum mark 
criteria has been established, the results of this analysis 
could not be used to cross-validate the results of the 
performance mark distributions obtained previously. However, 
the general trends and conclusions drawn from the previous 
analysis were supported by the distributions obtained. 

The overall conclusion from this portion of the 


study was that the performance marks derived under the present 


28 





system, which do not adequately differentiate among the 
performance of individuals, result in reducing the impact of 
the performance factor in the advancement system. 
2. Selection for Proficiency Pay 

As outlined in Commandant Instruction 1430.1F /Ref. 6/, 
proficiency pay has been granted only to those enlisted per- 
sonnel who have been serving in intelligence billets, re- 
cruiting billets, and recruit. and assistant recruit commander 
billets. Performance marks are not used as a factor in 
selecting personnel for proficiency pay. 

3. Selection to Warrant or Commissioned Status 

Enlisted performance marks have been used in the 
selection of personnel for commissioned status in an indirect 
manner. The determination of which enlisted personnel are 
best qualified for Officer Candidate School has been made by 
a selection board process. Enlisted personnel competing for 
selection have been required to obtain scores on the Officer 
Qualification Test above a minimum level and have the recom- 
mendation of their assigned command. These recommendations 
from the command include performance marks but the perception 
of people interviewed was that board members have had little 
confidence in the value or meaning of these marks and have 
relied more heavily on other factors when selecting candi- 


dates. As for the selection of warrant officers, a servicewide 
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competitive examination system similar to that employed in 
the advancement process has been utilized. However, a 
concession that the present performance evaluation system 
does not adequately differentiate senior enlisted perform- 
ance has been made. A special evaluation form, Evaluation 
Sheet for Appointment to Warrant Grade (CG-3875), has been 
utilized to assess the performance of candidates. 

In conclusion, the marks derived under the present 
enlisted performance evaluation system do not adequately 
serve a useful purpose for selecting enlisted personnel for 


warrant or commissioned officer status. 


4. Selection for Special Programs and Courses of 


Instruction 
a. Class A School Training 
The primary criteria for selecting personnel 

for Class A School training has been scores obtained on the 
Navy Basic Test Battery (BTB). Individuals have been 
selected from both recruit training and from the field. 
Since recruits have not been evaluated under the enlisted 
performance evaluation systems, performance marks have had 
no bearing on the selection of these individuals. For 
individuals selected from the field, in addition to having 
met the BTB score criteria, they must have received a recom- 


mendation from their assigned command. While an implication 
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has existed that a commanding officer should consider per- 
formance when recommending, an individual, the role of 
performance marks has been indirect. 


b. Advanced Electronics Training and Physician 
Assistant Training 


For both of these programs the selections have 
been made by board actions that use the special evaluation 
forms employed in the warrant officer selections. Perform- 
ance evaluations derived from the present system have had 
only an indirect or no effect in this selection process. 

c. Results and Conclusions 

The overall conclusion reached was that perform- 
ance appraisals made on the present form have played only an 
indirect role in the selection of personnel for special pro- 
grams and courses of instruction. Performance marks have 
not been adequate for this use and in most instances have 


been replaced by special evaluations. 


5. Selection of Personnel Eligible for the Good Conduct 
Medal 


Since 1 November 1963, the criteria, as specified by 
the Medals and Awards Manual (CG207-2) /Ref. 23/7, for a Good 
Conduct Medal has consisted of no court-martial conviction; 
no non-judicial punishment; no misconduct as determined by 


the Coast Guard Supplement to the Manual for Courts-Martial 


(CG-241) /Ref. 4/; no civil conviction for an offense 
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involving morale turpitude; and minimum performance marks 
of 3.0 in the proficiency, leadership and conduct for a 
period of four years continuous, active duty. As supported 
by the mark distribution computed from the CAC sample, per- 
formance marks recently have served to disqualify only a 
very few enlisted personnel. The authors also found it 
peculiar that the conduct mark criteria for awarding the 
Good Conduct Medal was less stringent than the conduct mark 
criteria for such other personnel actions as interdistrict 
and mutual transfer. 
6. Determination of the Type of Discharge 

The criteria that has been established to discrim- 
inate honorable service from less than honorable service has 
been based on performance marks. An average performance 
mark of 2.7 in proficiency and 3.0 in conduct has been deter- 
mined as the point for distinguishing service worthy of an 
Honorable Discharge from service worthy of a General Dis- 
charge. As witnessed from the CAC performance mark analysis, 
the present performance evaluation system has not identified 
less than honorable service. Only one of the 2310 marks for 
proficiency collected was less than 2.7 and no marks were 
below 3.0 j. conduct. In fact, only one additional pro- 


ficiency score was below 3.0. 
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7. Desirability for Reenlistment 


Since there has been no performance mark criteria 
established for determining the desirability for reenlist- 
ment, performance marks have not made any contribution for 
satisfying this use. Furthermore, the CAC mark distributions 
observed indicate that the present system has not adequately 
differentiated the performance of individuals and establish- 
ing a criteria for performance based on current marks would 
be of little value. 

8. Reduction in Rate for Incompetency 

The Enlisted Performance Evaluation Worksheet 
(CG-3788) and the Personnel Manual have stated that personnel 
receiving a proficiency mark of 2.0 to 2.4 should be consid- 
ered candidates for disrating (demotion) unless improvement 
is shown. A proficiency mark of 1.9 or less has indicated 
that disrating or separation action is being taken or is in 
order. The analysis of the current mark distribution has 
indicated that performance marks have not adequately identi- 
fied individuals who should have been reduced in rate for 


incompetency. 


9. Propriety of Early Separation by Administrative 
Discharge 


Since no performance mark criteria have been estab- 


lished for this purpose, performance marks have been of no 
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benefit for this use. Comments from the personnel inter- 
viewed indicated that the performance marks for individuals 
recommended for administrative discharge have frequently 
failed to reflect poor performance. 
10. Assignment of Enlisted Personnel 

While Article 4-C-5 of the Personnel Manual does 
not list performance marks as one of the factors in selecting 
personnel for transfer, other articles in Chapter 4 have pre- 
scribed some performance mark criteria for certain transfers. 
To qualify for an interdistrict transfer, an individual must 
have received proficiency and leadership marks of at least 
3.3 and a conduct mark of at least 3.9 during the last. regu- 
lar semiannual evaluation period. To qualify for an auto- 
geneous transfer (a transfer at the serviceman's expense, 
either a mutual exchange of station between personnel of 
the same rating and paygrade, or a unilateral change of 
station when an individual is in excess of the personnel 
allowance at his or her present duty station), an individual 
must have received proficiency and leadership marks of at 
least 3.3 and a conduct mark of at least 3.9 during the 
previous year. Since the Personnel Manual defines a mark of 
3.3 in proficiency and leadership as average, if the intent 
was to prohibit below average performers from receiving inter- 


district and autogenous transfers, this intent has not been 
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satisfied. Due to the experienced distributions of perform- 
ance marks, individuals in all paygrades with marks of 3.3 
are below the mean or average performance level. 

Comments from the interviews conducted with person- 
nel responsible for enlisted assignments indicated that 
assignment officers would like to assign enlisted personnel 
where they could be utilized most effectively. One aid in 
making this determination could be performance marks. How- 
ever, the interviews revealed that these officers have a 
general mistrust for the employment of performance marks in 
the assignment process. These individuals felt that there 
was so little variance in the assigned marks in several pay- 
grades for certain ratings that the marks were virtually 
useless. Furthermore, since only the numerical performance 
marks are forwarded, the assignment personnel could not 
identify why the marks were assigned and what strong or.weak 
traits or attributes an individual possessed that prompted 
the assignment of these marks. Command comments relating 
to the suitability for the requested assignment have been 
solicited on the Enlisted Assignment/Data Form (CG-4526) but 
frequently have not been completed or have consisted of a 
noninformational endorsement. When comments are provided, 
they frequently conflict with the performance marks on the 


form. In view of the situations described, it was easy to 
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understand why the assignment personnel have placed so 
little value on the role of performance marks in the 
assignment process. 

The comments received during the interviews with 
assignment personnel identified additional performance 
information that would benefit the assignment process. 

The first comment expressed by the majority of persons 
interviewed was that the comments describing an individual's 
performance would add significantly to the value of the 
numerical marks. A second comment that received consider- 
able endorsement was that more information relating to the 
actual duties being performed during each performance 
evaluation period would be beneficial. One final recommen- 
dation was that a command assessment of each individual's 
suitability for instructor duty, independent duty, and 
assignments involving contact with the public would be 
helpful. 

One assignment process which has explicitly consid- 
ered the role of performance in assignment has been the 
selection and assignment of enlisted personnel as officers 
in charge. As specified in Commandant Instruction 1306.11 
[Ref. 5/ the selection of these key personnel has been 
accomplished by review boards established at the district 


level. However, a detailed evaluation has been requested 
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of each commanding officer and a special evaluation form has 
been provided for recording the district review boards evalu- 
ation. For the October 1976 board, the Commander, Twelfth 
Coast Guard General District directed that nominees be evalu- 
ated on the Report of the Fitness of Lieutenant (junior grade), 
Ensigns, and Commissioned Warrant Officers with less than Two 
Years Service (CG-4328A). While individual service records 
containing the numerical performance marks have been reviewed 
as a part of this selection and assignment process, the 
present evaluation system has not adequately differentiated 
among individual performance to enable selection of the best 


performers for assignment as officers in charge. 


C. AN ANALYSIS OF THE MECHANICS OF THE PRESENT SYSTEM 
l. The Periodicity of Evaluations 

Several disadvantages of evaluating all personnel 
on the same dates have been identified. First of all, it 
has tended to reduce the amount of time available for com- 
pleting and reviewing each evaluation. Secondly, it has 
served to permit the comparison of individuals with others 
of different paygrades. Since all personnel have been eval- 
uated at the same time, a natural tendency has existed to 
compare each person's performance with a much larger group 
of individuals than just those of the same paygrade. Finally, 


as was supported by the distribution of performance marks 
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across all paygrades, it has disguised the fact that there 
has been little differentiation among the performance of 
individuals in the same paygrade. But from an aggregated 
viewpoint the appearance of a distribution has been per- 
ceived due to the inflation of marks with the increase in 
paygrade. 

2. The Present Evaluation Form 

The Enlisted Performance Evaluation Worksheet 

(CG-3788), included as Appendix B, has been used to evaluate 
all enlisted personnel regardless of paygrade. The implica- 
tion has been made that since all enlisted personnel have 
been evaluated on the same form they must perform similar 
tasks. It is the opinion of the authors that this does not 
M rately represent reality. Senior enlisted personnel have 
been required to perform numerous managerial skills while 
enlisted personnel in the middle paygrades have been assigned 
supervisory duties. The forms must be more applicable to 
some enlisted personnel than to others. A review of the 
descriptive terminology on the form has indicated that the 
form was best suited for more junior personnel. For instance, 
in the leadership evaluation blocks a person's potential for 
becoming a petty officer has been evaluated. If an individ- 
ual has already been advanced to a petty officer paygrade, 


then he or she must transcend this evaluation. This has 
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been a factor in the tendency for evaluations of more senior 
enlisted personnel to be inflated. Another factor that has 
produced the reported inflation was caused by the numerical 
scaling on the form. On a 4.0 scale, the section of the form 
marked "average" equates to a numerical score of 3.3. 

Another shortcoming of the form has been that a 
myriad of attributes have been clustered under the terms of 
proficiency and leadership. Aspects of a need for judgment, 
professional knowledge and skill, and advancement potential 


' while 


` have been included under the — "Proficiency;' 
aspects of confidence and morale, effectiveness and initia- 
tive, and petty officer potential have been included under 
the heading "Leadership." When an individual has performed 
at one level in some of these aspects but at a different 
level in other aspects, there has been no guidance provided 
for determining how the final mark should have been deter- 
mined. For some potential users of the marks, there has 
been no way of determining what subjective weighting was 
applied when the rater combined performance of varying 
degrees in the different aspects under the same term to 
derive an overall mark. Comments which might indicate the 
stronger and weaker aspects of an individual's performance 


have been required only for the highest and the two lowest 


evaluations. When comments have been provided on the worksheet, 
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the information has been lost since the forms were destroyed 
thirty days after the numerical marks were recorded in the 
individual's service record in accordance with the ee 
ons on the worksheet. If the instructions were changed 
to require copies of the worksheet to be forwarded to the 
district offices and headquarters, some additional, beneficial 
information would be preserved. It is the opinion of the 
authors that comments should be mandatory on all evaluations. 
Additionally, a specific listing of duties performed should 
be provided. The information assessing an individual's per- 
formance levels has been of limited value without knowing 
the specific duties or tasks the individual had performed. 
The exercise in which 15 officers matched the des- 
criptive terms from the present form to the adjective 
evaluations in the areas of proficiency, leadership, and 
conduct produced some interesting results. While the sample 
size was too small to permit a rigorous statistical analysis, 
approximately one-half the officers placed aspects of pro- 
ficiency and leadership in the opposite category from where 
it appears on the present form. This demonstrated that the 
two terms either have not been well defined or are not 
mutually exclusive. This observation was supported by the 
high intercorrelation between proficiency and leadership 


marks obtained from the CAC mark sample (Appendix D) and 
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has led the authors to conclude that all aspects of perform- 
ance should be evaluated separately rather than clustering 
several aspects into a few ambiguous categories. 
3. The Evaluation Chain of Command 
a. The Immediate Supervisor 

The initial evaluation of each enlisted person 
has been completed by the individual's immediate supervisor 
(also referred to as the first-line supervisor). The first 
difficulty with this procedure has been that no training 
in the evaluation of personnel was required and in most 
instances has not been provided. To aggravate this situa- 
tion, the only instructions detailing the workings of the 
system and describing how the ean form should have 
been completed have been published in the Personnel Manual. 
Due to the limited availability of copies of this publica- 
tion at each command, coupled with the fact that all immediate 
supervisors have been required to evaluate all their personnel 
during the same timeframe, a degradation in the quality of 
evaluation that an immediate supervisor can produce has been 
experienced. 

b. The Intermediate Review Process 

While the number of individuals reviewing each 

evaluation has varied from one command to another, no require- 


ment has been established for providing feedback to the 
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immediate supervisor on changes each reviewer has made or 
the quality of each evaluation. Consequently, most immedi- 
ate supervisors have received little assistance in improving 
their evaluation skills. 

c. Commanding Officer/Officer in Charge Approval 

It has been possible for each command to apply 
different standards for evaluation based on the varying per- 
ceptions of the system held by each commanding officer or 
officer in charge who must make the final approval on each 
evaluation. Consequently, no determination can be made as 
to whether small A. in marks reflect differences 
in rater standards or ratee performance. In the absence 
of information on the desired or experienced distribution 
of performance marks, this situation has been perpetuated. 
If feedback had been provided to each command comparing that 
command's mark distribution with either a desired or experi- 
enced distribution, it would have enabled the final review 
authority to draw an intelligent conclusion about his 
marking trends. 
‘4. The Appeal Procedures 

While a system for appealing performance marks has 
been established, the true value of the appeals procedures 
has been questionable. This situation has been the product 


of three factors. First of all, there has been no requirement 
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to inform an individual of the performance marks assigned. 
Secondly, the ratee has not been informed of the date when 
the assigned marks were entered in his service record. In 
the third place, the individual might not even be aware of 
the fact that he has a right to appeal. In view of these 

three factors, the existence of an appeal process, where a 
written appeal must be submitted within thirty days of the 
date performance marks were entered into an individual's 


service record, has been less than adequate. 


D. SUMMARY OF CONCLUSIONS 

The authors' analysis of the present Coast Guard enlisted 
performance evaluation system produced several conclusions. 
First of all, the system has not adequately satisfied the 
stated primary objective of differentiating among the per- 
formance of individuals. To facilitate future assessments 
of this nature, performance marks for all enlisted personnel 
ould be submitted to one location and regularly analyzed. 

secondly, the primary uses of performance marks have 
been perceived to be advancement in rate and assignment. 
Marks derived under the present system have not adequately 
contributed to either of these uses. The actual role of 
performance in the advancement process has been considerably 


less than intended. For assignments, performance marks have 


43 





played only a minor role and additional information would 
be required to increase the value of performance appraisals 
for this use. In both instances the small variance in marks 
for individuals of the same paygrade has been the major 
factor in reducing the benefit derived from the performance 
marks. 

A third conclusion was that performance marks have con- 
tributed only indirectly or have had no value in satisfying 
uses identified as secondary. A fourth conclusion was that 
the current evaluation form has been inadequate and should 
be replaced by a number of forms tailored to what various 
groups of enlisted personnel actually do in the performance 
of their duties. 

Another major conclusion was that evaluation submission 
schedule should be altered to permit staggered submission 
dates to avoid comparing individuals in one paygrade with 
others of a different paygrade. Additionally, this change 
would produce an increase in the amount of time that could 
be dedicated to evaluating each individual. 

The mechanics of the system should be altered to facili- 
tate the training of both raters and reviewers in the proper 
method and mechanics of evaluating enlisted personnel. 
Furthermore, the appeal process has been inadequate and 


requires a complete overhaul. 
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In addition, the present system has been directed only 
at satisfying the organizational purpose of aiding and 
justifying administrative actions. The system has totally 
ignored the counseling and development purpose for the 
individual. 

Finally, action has been taken to treat a number of 
symptoms such as creating and utilizing evaluation forms 
other than the Enlisted Performance Evaluation Worksheet 
(CG-3788) for certain specific uses, but the underlying 
illness, that the present system does not adequately and 
objectively differentiate among the performance of indi- 
viduals, has been ignored. Rather than perpetuate this 
practice, the conclusion is made that the present enlisted 


performance evaluation system should be replaced in its 


entirety. 
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III. PROPOSED COAST GUARD ENLISTED 
PERFORMANCE EVALUATION SYSTEM 
The proposed Coast Guard Enlisted Performance Evaluation 
System consists of a recommended format for the evaluation 
forms, a methodology for developing the evaluation headings 
on these forms, and a description of how the system will 
function over time. The new system is conceived as having 
two forms, a Significant Incident Form on which reports of 
observable actions are recorded by the immediate supervisor 
and an Enlisted Performance Evaluation Form which summarizes 
the data collected on the Significant Incident Form so as 
to allow for the necessary interface with other personnel 
areas such as advancement and assignment. This two-form 
approach was developed to separate for the immediate super- 
visor a means of satisfying both the individual's need for 
counseling and recognition and the organization's need to 


differentiate between the performance of individuals. 


A. DESCRIPTION OF FORMS 

Examples of the Significant Incident Form and the 
Enlisted Performance Evaluation Form are included as 
Appendices G and H. The evaluation headings on these forms 


have not been included as they have not as yet been 
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identified. The methodology to be employed in their identi- 
fication is, however, described below and in Appendix I. 
1. Significant Incident Form 

The Significant Incident Form has been developed as 
a tool for the immediate supervisor for counseling of the 
ratee while recording objective observations that are to be 
used in the end of period preparation of the Enlisted Per- 
formance Evaluation:Form. The Significant Incident Form 
was adopted in part from John C. Flanagan's "Performance 
Record" /Ref. 13/ published in 1955. Management by 
Objectives techniques were added to the basic "Performance 
Record" format in a way that can be successfully employed 
by a first-line supervisor. The evaluation headings on 
the Significant Incident Form and the Enlisted Performance 
Evaluation Form will be the same to ease the transfer of 
information and to retain objectivity in the assignment of 
end of period performance evaluations. 

The Significant Incident Form consists of one sheet 
of paper, approximately eleven by sixteen inches, that is 
folded to make a four-page form. The outside cover contains 
personal data on the ratee that is the same as that needed 
to complete the end of period form, a statement of assigned 
duties and objectives for the period, a record of projects 


worked on by the ratee during the period, a record of 
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training accomplishments for the period, and the name and 
rate of the immediate supervisor. 

Pages two and three consist of specific evaluation 
headings related to the overall evaluation areas of '"Perforn- 
ance of Duties" or "Personal Qualities." The specific eval- 
uation headings are designed to channel the immediate 
supervisor's observations toward those actions that lead to 
success or failure. Examples of actions that are either 
positively or negatively related to the specific evaluation 
headings are also to be listed to further direct the first- 
line supervisor in identifying appropriate significant 
incidents. These examples are taken from the initial 
responses collected for the Echo Technique discussed later 
and in Appendix H. 

Page four of the form consists of a record of 
counseling sessions. These sessions are documented as to 
the date and subject of each session and are authenticated 
by having both the supervisor and ratee initial the form 
at the end of the counseling session. 

2. Enlisted Performance Evaluation Form 

The Enlisted Performance Evaluation Form was developed 
in much the same format as the Coast Guard's officer fitness 
report forms. The form is a one-page optically scanable re- 


port designed to interface with other personnel systems such 
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as advancement and assignment. For ease of completion and 
transfer of information, this form will directly parallel 
the Significant Incident Form for the evaluation of 
"Performance of Duties" and "Personal Qualities." 

The Enlisted Performance Evaluation Form consists 
of several sections including a personal data section identi- 
fying the individual and his or her unit, a description of 
duties, objectives for the period, a training accomplishments 
section, the "Performance of Duties" and "Personal Qualities" 
sections, a "Conduct" section, a comments section, and a 
recommendation for future assignments section. This last 
section has been included to afford the command the oppor- 
tunity to assess an individual's potential for assignment 
in the areas of independent duty, recruiting and boating 
safety duty, and instructor duty. 

The scored areas of the form consist of the 'Perforn- 


' and "Conduct" sections. 


ance of Duties," "Personal Qualities,' 
The first two of these scored areas are completed using the 
data accumulated on the Significant Incident Form. 'Perfom- 
ance of Duties" marks are to reflect past performance during 
the period. "Personal Qualities" marks are to reflect the 
individual's potential for advancement. The nine point 


scale was chosen because of the Coast Guard's experienced 


success with this scale in the officer fitness report system. 
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A desired distribution for the overall scores in these two 
areas is given to aid the commanding officer in marking his 
personnel. A servicewide "experienced distribution" would 
eventually replace the ''desired distribution" on the initial 
“issue of the form. "Conduct" marks are to be continued on 
the four point scale and criteria of the present system due 
to the continuing need for these marks in their present for- 
mat for such administrative needs as awarding Good Conduct 
Medals and determining character of service. 

The proposed Enlisted Performance Evaluation Form 
is packaged as a six page unit including one page of instruc- 
tions, one worksheet, an original of the actual form, and 
three copies. Carbon paper is included between the original 
and each of the copies. The worksheet is similar to the 
actual form with the exception of having space allocated on 
the reverse side for comments and signatures of all personnel 
reviewing the form as it proceeds through the chain of 
command to the commanding officer at the end of the marking 


period. 


B. METHODOLOGY FOR DEVELOPING THE EVALUATION HEADINGS 
The method recommended for identification of evaluation 
headings for the forms is that of the "Echo Multi-Response 


Method" (Echo Technique) described by Barthol and Bridge 
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[Ref. Z]. The advantage of the Echo Technique over other 
methods such as job task analysis or a critical incident 
technique is that the terms derived through the use of the 
Echo Technique are in the current jargon of the personnel 
who will use the form. By identifying the descriptive terms 
in use by the field, greater face validity and acceptance is 
anticipated. A detailed description of how the Echo 
Technique would be employed is included as Appendix I. 

The authors considered various methodologies for devel- 
oping the evaluation areas to be used in the new performance 
evaluation system. Job task analysis of each paygrade and 
rating was the initial methodology considered. The data 
derived for the job task analysis would be clustered using 
a three-dimensional factor analysis approach where paygrade, 
rating, and task analysis responses would form the three 
dimensions. These clusters represent paygrades and ratings 
performing similar tasks and a separate evaluation form 
would be developed for each. This methodology was abandoned 
because the number of people would be exceeded by the number 
of variables in many of the factor analysis matrix cells, 
thus degrading the quality of the output of this methodology. 
Another disadvantage of this methodology is that the reasons 
why certain clusters were formed will not be apparent. 


Determination of evaluation headings becomes rather 
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arbitrary once the factor analysis has been completed. 
This may reduce the face validity of the new forms. These 
reasons led to the selection of the Echo Technique for 
development of the new forms. 

The evaluation headings for "Performance of Duty" will 
vary with paygrade, but if the headings are similar, as may 
be expected for paygrades with similar duties and responsi- 
bilities, composite forms that are clustered by similarities 
in paygrade may be developed. This would reduce the total 
number of different forms needed under the proposed system. 
The paygrades would be clustered by ten of the individuals 
randomly selected from the group who served as classifiers 
in the Echo Technique procedure. 

Many of the evaluation headings will be abstractions 
that do not in themselves contribute to the development of a 
servicewide performance evaluation system. The Significant 
Incident Form must be annotated with the examples chosen 
from those used in the Echo Technique to develop the evalua- 
tion headings. These terms should also be defined in the 
instructions accompanying the Enlisted Performance Evaluation 
Form. Use of techniques such as brainstorming and Mager's 
Goal Analysis Technique /Ref. 19/7 should be employed to 
further define and give examples of the abstract evaluation 


headings. 
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The final product of the methodology described above 
and in Appendix I are terms, in the current jargon of the 
Coast Guard personnel who will use and be evaluated with 
the proposed system, that identify areas to be evaluated 
under the general headings of "Performance of Duty" and 


' Additional guidance is also provided 


"Personal Qualities. ' 
the first-line supervisor through examples of observable 
actions to be considered in evaluating personnel (provided 

on the Significant Incident Form) and definitions and general 
examples of the abstract evaluation headings (provided in 


the instructions for the Enlisted Performance Evaluation 


Form). 


C. MECHANICS OF THE PROPOSED SYSTEM 
l. Training of Personnel 

The proposed performance evaluation system is more 
complex and more ambitious than the present system. Imme- 
diate supervisors are not presently trained in the areas of 
performance evaluation and counseling. Prior to implementa- 
tion of the proposed system, the first-line supervisors and 
their seniors in the chain of command must be trained and 
sufficiently motivated to perform in their new roles. Per- 
sonnel being evaluated under the proposed system must receive 
some instruction as to what to expect under the new system. 


Training is to be conducted at all initial points of entry, 
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including the Coast Guard Academy, officer candidate school, 
and recruit training. Class A Schools and petty officer 
leadership schools are also logical centers for this train- 
ing. Instruction must be ongoing with personnel performance 
evaluation and counseling sections added to advancement 
ses and examinations at the appropriate levels. A 
handbook for each supervisor is also necessary. 

2. Uses of the Significant Incident Form 

The Significant Incident Form outlines many of the 
activities that occur during the evaluation period. The 
period begins and ends with a Management by Objectives style 
of interview. Counseling occurs at these sessions and at 
the time that a significant incident occurs. Significant 
incidents, those actions that lead to the individual's 
success or failure, are recorded as they occur with immediate 
feedback provided to the individual. 

The Significant Incident Form is conceived as being 
used solely within the local command. Under the present 
enlisted performance evaluation system, there is no equiva- 
lent form or procedure for recording observations or for 
counseling during the period. The primary user of the form 
is the immediate supervisor who is solely responsible for 
recording the entries. The Significant Incident Form is 


the basis for the assignment of end of period (semiannual) 


54 





marks in the areas of "Performance of Duties” and "Personal 
Qualities." At the end of the evaluation period the Signifi- 
cant Incident Form is forwarded with the completed rough 
copy of the Enlisted Performance Evaluation Form through 
the chain of command to the commanding officer for his 
review. 

a. The Counseling Schedule 

During the initial session the first-line super- 
visor records the necessary personal data onto the Signifi- 
cant Incident Form. The supervisor outlines the duties and 
responsibilities of the ratee and then records these on the 
form. The supervisor and ratee then establish mutually 
acceptable objectives for the period. The first follow-up 
meeting is scheduled for one month later. 

Informal counseling sessions are to be held at 
least monthly. At these sessions past performance and pro- 
gress toward attainment of objectives are reviewed. Objec- 
tives may be changed during these mid-period sessions. 
Significant incidents are discussed with an emphasis on 
performance improvement and individual development. 

The end of period counseling session brings 
together the ratee, his supervisor, and his supervisor's 
senior (usually a division officer or department head). The 


Significant incidents that form the objective basis for the 


55 





semiannual report are discussed. Successes and failures in 
meeting the objectives for the period, training accomplish- 
ments, recommendation for advancement and advanced training, 
and other personnel related subjects are also discussed. 
After reviewing past performance, emphasis is shifted to the 
future. New objectives and the means for their attainment 
are mutually agreed upon. In this manner the end of one 
period is logically fused to the beginning of the next 
period. 

b. Observing and Recording Significant Incidents 

Past experience in civilian industry with per- 

formance evaluation techniques using forms similar to the 
proposed Significant Incident Form has demonstrated a need 
for recording observations on a daily basis /Ref. 12/. This 
does not mean that every supervisor has to record something 
on every subordinate every day. It means that all signifi- 
cant incidents observed during any particular day are to be 
recorded at the end of that day. The supervisor should not 
attempt to remember significant incidents for several days 
and record them at a later date. More frequent recording 
has led to a greater number of observations being recorded 
and therefore available at the end of the period. The first- 
line supervisor's senior, usually a division officer or 
department head, is assigned to check at random intervals 
for compliance with this daily entry requirement. 
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3. Uses of the Enlisted Performance Evaluation Form 

The Enlisted Performance Evaluation Form is designed 
to provide the necessary interface between a system oriented 
towards developing Coast Guard enlisted personnel through 
observation and counseling, and other personnel areas such 
as advancement and assignment. The principle use of the 
Enlisted Performance Evaluation Form is to quantify past 
performance of duty and personal qualities using the objec- 
tive information collected as recorded observations on the 
Significant Incident Form. These quantified evaluations 
are in a more usable format for comparing the performance 
of individuals. 

Of the many personnel related functions served by 
the present enlisted performance evaluation system, advance- 
ment and assignment are considered to be of primary import- 
ance. An evaluation system that differentiates between 
individuals sufficiently to serve the needs.of these primary 
areas, can be analyzed to develop standards for the secondary 
areas of selection for proficiency pay, selection for special 
programs and courses of instruction, determination of type 
of discharge and desirability for reenlistment, reduction 
in rate for incompetency, and determination of propriety of 


early separation by administrative discharge. 
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a. Quantifying Evaluations 

Regardless of how objectively and accurately 
observations are recorded on the Significant Incident Form 
during the period, a degree of subjectivity enters the pro- 
posed evaluation system process when marks are assigned on 
the Enlisted Performance Evaluation Form. A conscientious 
effort has been made to reduce this subjectivity through 
the training program for raters, a desired or experienced 
servicewide distribution of marks by paygrade for guidance, 
and an information system to provide feedback to individual 
commanding officers. The present performance evaluation 
system has not addressed any of these areas and as a result 
each commanding officer sets a different standard based on 
his own personal experiences. The proposed system attempts 
to rectify this problem and develop a truly servicewide 
standard with which to compare individual performance. 

b. End of Period Procedures 

At the end of an evaluation period, usually six 
months, the first-line supervisor completes the Enlisted 
Performance Evaluation Worksheet using the information from 
the Significant Incident Form and the results of the end of 
period counseling session. The worksheet and Significant 
Incident Form are forwarded through the chain of command 


where additional comments are added. After approval by 
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the commanding officer, the Enlisted Performance Evaluation 
Form is typed as an original and three copies and signed 
by the commanding officer. 

One copy of the form is retained by the command, 
forwarding the original and two copies to the district office 
where they are checked for completeness. For nonrated per- 
sonnel the district will file one copy for use in endorsing 
future personnel matters concerning the individual, use one 
copy for assignments, and forward the original to head- 
quarters for entry into the individual's service record. 

For rated personnel the district will retain one copy for 
use in endorsing future personnel matters concerning the 
individual. The original and one copy are forwarded to 
headquarters for entry into the individual's service record 
and for use in assigning the individual. For all enlisted 
personnel, the original of the form is optically scanned at 
headquarters prior to being filed in the individual's 
service record. 

After the district has reviewed a unit's evalua- 
tions for completeness, evaluations that are found to be 
incomplete are returned. The command is also advised at 
this time to show the unit's copy of the evaluation to these 
individuals whose evaluations were found to be complete. 


Confidentiality of the report is maintained until after the 


59 





district's review and forwarding to headquarters to curb 
the inflation usually associated with non-confidential 
performance evaluation systems /Ref. 30/. 

Submission dates are to be staggered throughout 
each semiannual period. The staggering of submission dates 
allows more time for evaluation and preparation of forms 
than the present system of evaluating all personnel semi- 
annually on the same date. For months when more than one 
paygrade have to be evaluated, dissimilar paygrades will be 
evaluated so that the evaluation of one paygrade will not 
influence another. 

The Enlisted Performance Evaluation Form must 
be computer readable for continual analysis of evaluation 
marks by paygrade and rating. Computer processing of the 
form also permits the generation of feedback reports to the 
commanding officer comparing his evaluation with the current 
experienced servicewide distribution. 

An appeals system similar to the one found in 
the present evaluation system is retained in the proposed 
system. Enlisted personnel have the right to appeal their 
marks within thirty days of reviewing their semiannual 
evaluations. The right of appeal is to be clearly explained 


at the time that the individual reviews his or her marks. 
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D. CRITIQUE OF THE PROPOSED SYSTEM 
1. Summary of Advantages 

The proposed Coast Guard Enlisted Performance Evalua- 
tion System has taken into account both individual and 
organizational needs while remaining within the capabilities 
of the typical immediate supervisor. The two form approach 
separates the often conflicting goals of counseling and 
individual development from personnel evaluation to be used 
for administrative purposes. 

The Significant Incident Form directs the super- 
-visor's attention to those areas of subordinate performance 
and behavior that are associated with success or failure. 
Objective observations that relate to the evaluation head- 
ings are recorded following the specific examples provided. 
Counseling and individual development are the principle uses 
of this form though the information recorded thereon is 
necessary for objective evaluation of personnel on the 
Enlisted Performance Evaluation Form. By using the same 
evaluation headings in the areas of "Performance of Duty" 


" the transfer of information from 


and "Personal Qualities, 
one form to the other is accomplished with a minimum of 
difficulty. 


The proposed system contains positive steps to 


standardize a servicewide evaluation system. Through the 
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training of personnel, establishing of desired, and later, 
experienced servicewide distributions, using a feedback 
system to commanding officers, a more equitable performance 
evaluation system is derived. 
2. Areas Not Previously Addressed 
a. Interface with Present System 

A conversion table for a one time conversion of 
performance evaluations from the present system to the new 
system must be developed. The table must take into account 
the mean and standard deviation of marks by paygrade and 
rating under the present system and the desired distribution 
of the proposed system. Conduct marks do not need to be 
converted since the proposed system has retained the same 
scale and methodology as the present system. New standards 
of performance must be also established for each of the 
administrative procedures that are dependent upon the 
performance evaluation system. 

b. Differences between Ratings 

Construction of the forms for the proposed per- 
formance evaluation system assumed a high degree of homo- 
geneity across ratings of the same paygrade. Since personnel 
compete for advancement and assignment only with peer per- 
sonnel of the same paygrade and rating, any biases in the 
forms themselves would effect all competing personnel to the 


same degree. 
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C. Impact on Servicewide Examination Schedule 
The servicewide examinations are now scheduled 
to follow the semiannual evaluation dates of all personnel. 
Staggering of evaluation dates by paygrade over a six month 
period may lead to the necessity of scheduling servicewide 
examinations by paygrade to correspond with the staggered 
semiannual evaluation dates. 
d. Personnel Working Out of Their Rating 
No provision has been made in the proposed system 
for the use of performance evaluation marks for advancement 
and assignment for personnel working out of their rating. A 
possible way of alleviating this en inerent in both the 
present and proposed systems is to combine such areas as 
recruiting, recruit training, and career counseling into one 
rating, while establishing separate ratings for intelligence 
and port security. Entrance into these new specialty areas 
would be at the first class petty officer level. These areas 
account for the greatest numbers of personnel working out of 


their rating. 
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IV. CONCLUSIONS 


The Coast Guard Enlisted Performance Evaluation Syston 
presently in use does not adequately differentiate between 
the performance of individuals. The perception held by many 
users of performance evaluations that marks inflate with an 
MR case in paygrade is supported by the analysis of marks 
from two major subsets of the enlisted population, those 
individuals requesting transfers and those recommended for 
advancement. There is no location where all current enlisted 
performance evaluation marks are available for analysis and 
no past studies with which to compare the results of this 
paper. During the research phase of this study, other areas 
of the Coast Guard's overall enlisted personnel management 
program that interface with the performance evaluation 
system were examined. Future study in the areas of enlisted 
advancement and assignment was indicated. 

Performance evaluation marks have been found to vary by 
paygrade and community. Marks for proficiency and leader- 
ship have been found to be highly correlated indicating that 
the present system has not been able to adequately measure 
two distinct traits or attributes. Conduct marks have been 


found to be almost universally 4.0 but this result was to be 
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expected since the Personnel Manual indicates that Conduct 
marks are normally 4.0. 

Failure of the present system to adequately differentiate 
between the performance of individuals has impacted on other 
personnel areas that are to some degree dependent on perform- 
ance evaluations. The enlisted advancement system was 
designed to give a theoretical percentage weight of 27.78 per 
cent to performance evaluation marks. Due to the small 
variance that exists in marks for those in competition, the 
actual percentage weight that can be attributed to perform- 
ance evaluation marks was 15.33 per cent for all personnel 
competing in the March 1976 Servicewide Examinations. 

The present enlisted performance evaluation system has 
lost the confidence of the personnel who have used the marks. 
Another performance appraisal instrument, the "Evaluation 
Sheet for Appointment to Warrant Grade" (CG-3875) has been 
instituted to remedy the shortcomings of the present system. 
Enlisted personnel being reviewed for qualification for 
officer in charge assignments are presently being screened 
using a special evaluation form that does not take into 
account past performance evaluation marks /Ref. 5/7. Perform- 
ance marks have been dropped as a factor in determining 
qualification for proficiency pay. Assignment officers have 


expressed a reluctance to use performance marks at face value. 
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In general the present enlisted performance evaluation 
system has failed to adequately differentiate between the 
performance of individuals. Rather than actually treating 
this problem, the Coast Guard has resorted to treating the 
symptoms of the problem by developing new forms and evalua- 
tion methods designed to bypass the enlisted performance 
evaluation system. The present system has failed to pro- 
vide usable individual performance information for related 
personnel functions. 

Counseling for personnel development is virtually non- 
existent under the present system. Performance evaluation 
systems to be effective must be designed to meet organiza- 
tional and individual needs. The present system does not 
meet the needs of either. 

The proposed enlisted performance evaluation system has 
been developed to meet the needs of both the organization 
and the individual. The two form approach was chosen so as 
to separate to some degree those factors that are in conflict 
when designing a performance evaluation system to meet both 
types of needs. The terms used as evaluation headings for 
both forms are to be developed through the Echo Technique 
to ensure that behaviors and traits that lead to individual 
success or failure are identified in the jargon of the 
personnel who are to use or be evaluated with the proposed 


system. 
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For "Performance of Duty" and "Personal Qualities" a 
nine point scale similar to the one found on officer fitness 
reports is to be used. Desired or experienced distributions 
and a servicewide feedback system are designed into the sys- 
tem to aid in the formation of a truly standardized system. 
Training of personnel is to be an important part of the 
system's implementation and of the ongoing program. The 
staggering of submission dates by paygrade is designed to 
allow more time for the evaluation process. 

The Significant Incident Form is directed primarily 
towards the individual's needs for development and recogni- 
tion. This form leads the first-line supervisor through 
the six month evaluation period. Use of the objective 
information recorded thereon allows for more accurate semi- 
annual evaluations. The Enlisted Performance Evaluation 
Form serves as the interface between the performance of the 
individual and the organization's needs for a quantified 
performance evaluation that differentiates between 
individuals. 

Prior to servicewide implementation, the system must be 
evaluated at a representative number of commands and staffs. 
Leniency, interrater reliability, and test-retest reliability 
can be evaluated using case studies and during a one year 


test period in the field. Ease of use by supervisors and 
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need for training must also be evaluated during this test 
period. Self-report measures of rater and ratee confidence 
must also be considered. 

After implementation of the proposed system, an auto- 
mated analysis program must be established to allow for 
continuous review of evaluation marks by paygrade, rating, 
command, and community to identify variations in marking 
standards. The feedback system to commands should be estab- 
lished initially as an advisory program, then as a counseling 
program conducted at the district level. Experienced service- 
wide distributions by paygrade should replace desired dis- 
tributions on the initial issue of the form to instill 
greater face validity. 

The proposed enlisted performance evaluation system has 
many advantages over the present system. The tradeoff for 
these advantages is with the amount of time necessary to 
complete two forms. The proposed two form approach will 
foster counseling and development of Coast Guard enlisted 
personnel while generating objective performance evaluations. 
Other tradeoffs exist when all aeo in one paygrade are 
evaluated on the same form assuming homogeneity of tasks 
performed by individuals of the same paygrade. As has been 


discussed, other methodologies could be utilized that avoid 
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this assumption, but they too have deficiencies. In short 
a perfect performance evaluation system can never be 
developed. 

In conclusion, it is the opinion of the authors that the 
proposed enlisted performance evaluation system will signifi- 
cantly enhance the quality of information available to 
facilitate systematic and equitable judgments for such 
administrative actions as promotion, transfer, and termina- 
tion. Furthermore, the proposed system addresses the needs 
of the individual for counseling and career development. 
Performance evaluation is not an end in itself, but rather 
a portion of an overall personnel management system. How- 
ever, only through analyzing the components of the overall 
system, identifying their shortcomings, and developing 
corrective action can we increase the efficiency and 


effectiveness of the Coast Guard personnel management system. 
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APPENDIX A 


Evaluation of Performance of Enlisted Personnel 


Section B--EVALUATION OF PERFORMANCE OF ENLISTED PERSONNEL 


10-B-l GENERAL 


(a) Genera! Policy. It is not the policy 
or the intent otthe Commandant to dictate 
the levelof marka tobe assigned Sy come 
manding officers. [tis the intent of this 
Section to impress upon all commanding 
officers the imoortance ofannonest eval- 
uation ot enlisted personnel under their 
command and to strive to insure tnata 
uniform system ot marking is maintained 
throughout the Coast Guard according to 
the guidelines laid down herein. it is of 
primary importance to differentiate be- 
tween the outstanding, the excellent, the 
average, the belowaverage andthe ungat- 
isfactory. A marking system serves no 
other purpose. Apolicat:on of marks ota 
unit to an ideal distrioution curve is not 
feasible and therefore is not required or 
expected. Strict and conscientious use 
of the Enlisted Performance Evaluation 
Worksheet (Form CG-3788) andtne Con- 
version Table is all that ig required. 

(b) Utilization of Marxs. Performance 
marks are used :o determine: 

(1) A factor for advancement in rate 
score. 

(2) Selection for proficiency pay. 

(3) Selection to warrant or commis- 
sioned Status. 

(4) Selection for soecial srograms, 
projects. and courses bi instruction. 

(5) Good Conduct Medal. 

(6) Type of discharge. 

(7) Desirability {or reenlistment. 

(8) Reduction in rate ¿or incompe- 
tency. 

(9) Propriety oí 2arly separation Sy 
administrative discharge. 
10.3-2 EVALUATIONS 

Evaluations will Je made and recorded 
in three areas of performance designated 
as Proficiency (P), Leadessaio {L) and 
Conduct (C), as follows: 

fa} Regular evaluation :s one :vn:ich is 
made and recorded semiannually as st 
30 June and 31 Desemser ans which nor- 
mally covers the entire O-mortr period, 
[f a marks entry has been made within the 
last 3 months, this regular svaluation 
need not de made. 

(b) Soecial evaluation i3 Ine which :s 
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made and recorded ags ofa date other than 
the regular evaluation date. Soecial eval- 
uations shall be made and recorded 

(1) On advancement to each petty ot- 
ficer rate. and On each change of rate, 
only if more than 3 months since last 
marks entry. Marksare assigned for the 
rate from which advanced or changed and 
will be datzd the day previous to the ef- 
fective date of advancement or change. 

{2) In all cases of reduction in rate, 
with the exceotion of incomoetency (see 
Article 3-C-38), only if more than 3 months 
since last entry, Intne case of a member 
reduced in rate who wags not presentto be 
observed in the performanceofhis duties 
for a period of 3 months or more since 
last marks entry, the marksassigned for 
Proficiencyand Leadership will 5e "IOT" 
(insutiicientobservationtime). Marks are 
assigned forthe rate from which reduced. 

(3) On transter foroermanent change 
ot station or closing out of the service 
record if more than 3 months since last 
marks entry. 

(4) On transter for temporary addi- 
tional duty or uponhosoitalizationifmore 
than 3month3 3ince last mark3 entry and 
if it is exoectedthatthe transferee will noe 
have returned to nis permanent duty sta- 
tion by the next prescribed evaluation date. 

(5) Cn transter trom more chan 3 
months' TO, TAD, or hosoitalization if 
more than 3months since last marks entry. 

(6) Uoon completion of recruit train- 
ing (conduct only). 

(7) At anyadditional time a command- 
ing officer con3iders aporopriate. 

(c) [n case >n individual ¿s in a disci- 
plinary status orisan unauthorizedabsen- 
tee on the date of evaluation. whether reg- 
ular or speciai. eacr trait other than con- 
duct shalloe entered. After disoosition of 
the case. a memorandum entry for con- 
duct shall be made ən page ó ot the service 
recordio snow the markawardedandto 2e 
etfective ag ot the date it normally should 
nave been made. Marks entries will not 
2e made ‘or other intervening scheduled 
evaluations s¢ecurring during an unautho- 
rized absence. 

(d) A soecial evaluation made in accor- 
dance with (b) above, forveriods under 
recruit training, hosoitalizacion or con- 
tinement, shall oe made only in Conduct. 
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Personnel under instruction other than 
recruit training will be marked only in 
Conduct during such instruction. The 
marks assigned for Proficiency and 
Leadership will be "SUT" (Student 
Undergoing Training). 

(e) Personnel in pay grades E-l and 
E-2 are not required to be marked in the 
Leadership trait. The minimum period 
required for a special evaluation and the 
relative importance of the use of the 
marks require thar all enlisted person- 
nel in pay grade E-3 and above continue 
to be assigned marks in all traits. 


10-B-3 CUIDE FOR USE IN 
EVALUATING 


(a) Evaluations should reflect an indi- 
vidual's performance since his last re- 
corded evaluation. The evaluation of 
instructors or recrutters will reflect in- 
structor or recruiting periormance. 
Likewise, if the individual during the 
marking period is performing duty 
outside of his technical area such as 
master-at-arms,etc., the evaluation 
will reflect how well the person is 
performing the special duty. 

(b) Based upon recognition of the fact 
that the vast majority of enlisted person- 
nel are competent in the performance 
of their duties, the officers responsible 
for awarding marks should conscientiously 
try to differentiate between the degree of 
performance demonstrated Sy individuals 
in the same pay grade. 

(c) There must inevitaoly be a higher 
standard of required, as well as actual, 
performance with each higher pay grade. 
This results from increasing experience 
level and stature with each higher pay 
grade and the fact that those individuals 
of lesser performance are eliminated oy 
competition for advancement. in view 
of this inherent increasing level of 
performance, it must de rememoered 
that individuals within a oay grade are 
evaluated against the performance of 
others in the same pay grade and not 
against that of personnel in higher or 
lower pay grades. 
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10-B-4 THE EVALUATION PROCESS 


{a) Immediate Supervisor 

(I) The process of evaluation onan 
enlisted member starts with the immedi- 
ate supervisor. This petty officer, 
division officer or civilian supervisor 
evaluates each member under his/her 
responsibility in comparison with all the 
rest of the personnel known in the same 
Day grade and not only with those in the 
presently assigned unit or office. After 
evaluation, the supervisor completes 
tne Enlisted Performance Evaluation 
Worksheet (Form CG-3788) >n each 
member evaluated. [nthe instance of 
civilian supervisors, care should be 
taken to insure that equitable performance 
standards are applied to the evaluation 
process. Guidance may be sought from 
the next immediate military superior. 

(2) How To Complete the Enlisted. 
Performance z.valuatıon Worksheet 
(Formica pics a). °° s 
— 37 © OF each man you are going to 
mark, fill in the information required in 
the spaces at the top and bottom of the 
form. 

S. Read the instructions on the 
form. For eachtrait, read all the de- 
scriptions in the boxes, 

c. When you evaluate the man, 
comoare him with others of the same 
pay grade. Ask yourself ‘How well is 
he >erforming the required duties of his 
grade in his assigned d:ller?" If his 
major duties have not deen those 
generally required by his rate during 
the period for which he is deing marked, 
mark him on what he actually did and 
how well he did it. Then descride what 
he did inthe "Comments" section. Decide 
which description fits the man best. 
Place a checkmark in the boxes beside 
the description. 

d. Notice that for each trait, the 
boxes at the extreme top and bottom are 
starred. This means that a mark in 
any of these boxes must be exolained in 
the ''Comments"” section. The explana- 
tion should give examoles of performance, 
good or bad, to show why the mark was 
assigned. 
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PERSONNEL MANUAL 


(b) The Commanding Officer 

(f) The commanding officer or offi- 
cer in charge is responsible for the final 
evaluation and determination of the marks 
to be assigned in the three traits. This 
officer should realize that his responsi- 
bility includes modifying the worksheet 
in accordance with his judgment as well 
as thar of converting the evaluation to 
amark. He shall consider the initial 
evaluation (Form CG-3733), entries on 
pages +,7 and 12 of the individual service 
record, the unit punishment book and 
other records in assigning marks from 
the table contained in Article 10-B-3. 
Commanding officers may mark higher 
or lower than the stated standards when 
their judgment of an enlisted person's 
performance indicates that a more 
accurate evaluation would result. 

(2) Conduct 

a. It is anticipated that the 
majority of individuals who have no 
offenses will be marked +.0 in Conduct. 

b. For courts-martial offenses 
consideration should be given not only 
to the type of court or punisnment 
adjudged, but also the type and serious- 
ness of the offense committed. 

c. Considerable latitude is per- 
mitted in assigning marks tor a period 
where minor offenses are involved. The 
commanding officer must consider the 
type and seriousness of the otfense(s), 
and may, for repeated offenders, mark 
in the 1.9-0 zone. On the other hand, 
while the 3.9 - 3.3 zone is normally 
reserved for the enlisted person com- 
mitting not mors than one minor offense, 
the commanding officer may use this 
zone for the enlisted person committing 
more than one minor offense waich the 
commanding officer does not consider 
to warrant a lower mark. 

d. It is the responsibility of the 
commanding officer :o determine if a 
civil offense which results in conviction, 
action that amounts to a fincing of guilt. 
or forfeiture ot 5ail i3 of a minor or 
major nature as compared to similar 
offenses covered by tne Uniform Code of 
Military Justice. 
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l. Certain civil convictions such 
as parking violations or soeeding a few 
miles in excess of a speed limit must be 
evaluated carefully to avoid inappropriate 
and unjust lowering of Conduct marks. 
Very minor civil oftenses should be 
treated as offenses not warranting 
punishment. 

2. If determined to be a minor 
offense, it should be treated as a non- 
judicial punishment. [f determined to be 
a major offense, it should be treated as 
a court-martial. 

e. Whenever a mark below 3.3 is 
assigned in Conduct, and the service 
record contains no entries during the 
marking period to substantiate such a 
mark, a page 7 entry of explanation 
must be made. 

(3) Proficiency and Leadership. 
These marks shall de assigned with care 
30 that each man is accurately evaluated 
in relation to others in nis pay grade. 


L0-B--Page 3 Am. 54 


72 





10-B-5 


10-B-3 CONVERSION TABLE 


(a) Proficiency and Leadership 
Proficiency 


(His skill, efficiency, and knowledge of 
his soecialty. His demonstrated ability 
to perform etfectively. ) 


For his pay grade, he is IDEAL. Little 
room tor :mprovement. Maximum 
professional knowledge. Exceptional 
skill and judgment. Requires no 
supervision and minimum guidance. 


For his nav grade, he is OUTSTANDING 
in protessional knowledge, skill and 
judgment. Needs no supervision for 
routine matters and minimum supervi- 
sion for new situations. 


For his oay grade, he is EXCELLENT. 
Has very elective xnowledge, skill and 
judgment. Needs no supervision for 
routine matters but moderate supervi- 
sion for new situations. Does well on 
his own. Very well qualified for ad- 
vancement. 


For his oav grade, he is ABOVE AVER- 
AGe. Cood «nowledge of rate. Skilled. 
Needs minimum supervision for routine 
matters. Works well on his own for 
limited periods and details. Well qual- 
ified for advancement. 


For nis pay grade, he is AVERAGE. 

Knows rate satisiactorily. Needs min- 
imum supervision for routine work as- 
signments. Qualified for advancement. 


he i$ SLICHTLY 

in knowledge and ef- 
fectiveness. Normal supervision needed 
in almost all assignments. Additional 
training and/or experience will qualify 
him for advancement. 


For his oay grade, 
AV 
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Leadership 


(His ability co plan and assign work to 
others, anda to effectively direc: their 
activities and his ability to mainrain 
proper military relationships with other 
service personnel. Ability to recognize 
and carry our his civil rights; human 
relations responsibilities. ) 


For his pay grade, ne is IDEAL. In- 
Spires nighest confidence and morale. 
Outstanding skill in directing others. 
Uniform immaculate. Fine military 
bearing. Outstanding initiative. 


For his pay grade, he is OUTSTANDING. 
Inspires nigh morale and confidence. 
Very effective in difficult circum- 
stances. Outstanding petty officer mate- 
rial. Great pride in uniform., Excellent 
military bearing. Excellent initiative. 


For his pay grade, he is EXCELLENT. 
Promotes morale and confidence. Ef- 
fective at most times. Gives orders 
well. Excellent oetty officer material, 
Pride in uniform. Military. Strong :n- 
itiative. 


For his pay grade, heis ABOVE AVER- 
AGe. Develops good cooperaticn and 
teamwork. Maintains good morale and 
respect. Makes orders effective. Very 
good petty officer material. Military 
and wears uniform well. Good :nitia- 
tive. 


For his pav grade, he is AVERAGE. 
Maintains morale and respect. Cets 
adequate results from nıs men. Good 
petty officer material. Presents good 
bearing and appearance. Has initiative. 


For his pav grade, he is SLIGHTLY 

& A v = £. Maintains own 
morale. Achieve fair results. Fair 
petty officer material. Good apoear- 
ance most of the time. 
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PERSONNEL MANUAL 


Proficiency 


Forhis pay grade, he is BELOW AVER-} 
AGE in proficiency, effectiveness, and 
skill. Does wellwhen supervised but is 
somewhat inadequate unless guided. 

Promotion material only after additional 


training and experience. 


For his pay grade, he is WELL BELOW 
AVERACE :nefrectiveness, proficiency, 
and skill. Barely satisfactory. Close 


supervision required. Goodwork offset 
by frequent poor performance. 


For his pay grade, he is UNSATISFAC- 
TORY. Sor in skill and effectiveness. 
Competency questionable. Needs con- 


stant supervision. Candidate for dis- 
rating unless improvement is shown. 


For his »av grade, he is GROSSLY IN- 
ADEQUATE. Incompetent in simplest 
tasks. Disrating or separation action 
in order or being taken. 


(b) Conduct 


4.6 3.39 to 3.3 


Conduct good. Con- 
forms to military 


standards and regu- ally lax. No 
lations. No courts- courts-martial 
martial convictions, convictions. Not 


nonjudicial punish- 
mentor minor civil 
convictions. 


judicial punish- 
ment or minor 
civil conviction. 
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Conduct satisfac- 
tory butoccasion- 
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Leadership 


For his pay grade, he is BELOW AVER- 
AGE. Usually maintains morale. Poten- 


tial petty officer material. Gets fair re- 
sult3 at times. Fair appearance. Below 
average initiative. 


For his va rade, he is WELL BELOW 
AVERACE. Morale falls off. No initi- 


ative. Seldom gets good results. Pos- 
sible petty officer material with hard 
work./ Poor appearance on many occa- 
sions. 


For his pay grade, he is INADECUATE. 
Poor morale. No initiative or interest 


in improvement. Often in trouble. 
poor petty officer material. 
sponsibility. Nonregulation. 
uniform improperly. 


Very 
Evades re- 
Wears 


For his pay grade, he is GROSSLY IN- 


ADEOUATE. Negative morale and ini- 
tiative. May be "ringleader" when in 
trouble. Constant source of irritatiqn. 


No petty officer potential. Sloppy ap- 
pearance. 
32 tos2 5 2. 4 to C 


Conduct unsatis- 
factory. Repeat- 
edly commits minor 
military and/or 
civil offenses or 
convicted by special 
or general court- 
martial. 


Meets minimum 
standards ofcon- 
duct, or not more 
than one summary 
court-martialcon- 
viction, or not 
morethan2 minor 
offenses (NIP or 
civil) during the 
period. 
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10-B-6 CORRECTIONS OR CHANGES 
IN EVALUATION MARKS 


A commanding officer is authorized to 
correct or change any performance of 
duty marks which were assigned by him. 
The commanding officer is also autho- 
rized to correct performance of duty 
marks assigned by another command 
where it is obvious that a mark nas been 
assigned which is contrary to instruc- 
tions which were in effect at the time the 
mark was assigned. In such cases a full 
explanation shall be forwarded to the 
Commandant (G-PE) when the corrections 
are made. In addition, a short explana- 
tion of the reason for the: change shall be 
inserted on page 6 (Form CG-3306) as 
near as possible to the corrected mark(s). 
All changes or corrections will 5e made 
in ink and signed in full, including title 
of the officer making the change or 
correction. Erasures shall not de made. 
If marks assigned include consideration 
of offenses committed for which punish- 
ment was awarded and the proceedings 
are subsequently set aside, such marks 
shall be reevaluated and properly reen- 
tered on page o. 


PROCEDURE TO APPEAL 
ASSIGNED MARKS 


K10-B-7 


(a) An enlisted member who considers 
the marks assigned to him unjust mav. 
through proper channels, apoeal to the 
district commander or, if assigned to a 


Headquarters unit, to Commandant (G-PE). 


Such appeal wiil be forwarded and decided 
promptly. Marking officers shall estab- 
lish suitable internal procedures to assure 
that each enlisted person is afforded the 
ooportunity to see his own marks prompt- 
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ly aiter they are entered in his service 
record and that he is apprised of the 
right to apoeal provided in this Article. 
Counseling and clerical assistance to 
prepare appeal shall be provided. An 
appeal not made within a reasonable 
time may be rejected by the superior 
authority. I= the adsence of unusual circum- 
stances, an appeal made more than 30 
days after the marks were assigned may 
be considered as not having Seen made 
within a reasonable time. Appeals shall 
be made in writing and shall include the 
appellant's reasons for regarding the 
marks unjust. In acting upon an appeal 
the superior authority may raise the 
marks of the appellant or leave them un- 
changed. He may not lower any marks 
assigned by the commanding officer or 
officer in charge. 

(5) Appraisals of one human being by 
another are inherently subjective in 
nature. Even when the person being 
appraised perceives no difference in his 
performance from one period to the next, 
small variations in marks received from 
the same marking officer may be ex- 
pected. Such vagiations are even more 
likely when there has been a change in 
marking officer. It is not intended that 
the appeal procedure be used merely to 
dispute tne judgment of the marking offi- 
cer. Thus. an individual who in the pre- 
vious marking period received a mark of 
3.3 and sudseouently is assigned a mark 
ot 3.4 would ordinarily have no basis 
upon wnich to appeal. The agpeal pro- 
cedure is to allow for review of low 
marks assigned to an individual when he 
feels that the low marks were based upon 
incorrect information, prejudice, dis- 
crimination or are cisprooortionately 
low for the particular circumstances. 
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APPENDIX B 


Enlisted Performance Evaluation Worksheet 


TREASURY DEPARTMENT 


U. 5. COAST GUARD 
CG-3788 (Rev. 2-61) ENLISTED PERFORMANCE EVALUATION WORKSHEET 


mark (Last, Firet, Middle) RATE age. 


INSTRUCTIONS 
. Complete the information required in the spaces for coach S. Pick the phrase which beat {its the mag in each trait and 


men eveluated. Mark Proficiency and Leadership in check the box beside it. The top box ıa always a littie 
spacee provided and Coaduct on reverse. better haa the next lower one. Be impartial. Avoid 
personal likes and dialikes. Be firm. Make your marks re- 
. For each treit, evaluate he mea on his sctual performance. floct how the man haa actually performed. De cet guess. 
Do not form your opimons from iaolated incidenta. Do not 
be influenced by rumors. Your duty requires that you 
evaluate eoch man os accurately oa peasible, 


- If the major portion of hia work has been outside his rating . Note that aome of the boxes on the extreme top and bottom 
or pay grade during this reporting period, evaluate him oa of the form are atarred and require that a mark in any of 
what he did, as compared to what a man of hia rate would those boxes must be oxpisined. The explanations should 
normally be expected to do. Describe whet he did in the give examples in the ‘‘Commenta’’ section, good or bad, to 
Comments” sectioa. show why the mark was assigned. 


PROFICIENCY LEADERSHIP 


. Conaider the requirements of his rate, the performance of 
others in hia rate and his ability in duties outaide hua rate. 

















(His obillty ta plan and assign werk to othera, und te 
eHectively direct their cetivities and his ability he 
maintain proper military relationshipa with ether 
service persennel,.) 


{Hie skill, efficiency, and knowledge of hia specialty. 
His demon a ahllin, to perform ero) ar 











Fee hia pay grade, te is IDEAL, Little room for im- | 
provement. Maximum profeesioaal knowledge. Excep- 
tioned skill and judgment. Requires ao supervision and 


For his poy grede, he ia IDEAL. Isapires highest 
confidence and morale. Outstanding ak:ll in directing 
ethers. UWnusform immecuste. Fine military bearing. 

Outstanding initiative. 














For hia poy grade, he ia OUTSTANDING in professional 
knowledge, skill, and judgment. Needg ac supervision 
for routine matters end minimum supervision for new 
aitustions, 


For his pey grade, he ia OUTSTANDING, Inspires 
high morate and confidence. Very eifective in diffi- 
cult circumatances. Outetanding petty officer material. 
Greet pnde in uniform Excoilent military bearing, 
Excellent initiative. 


Foer hie pay grade, he ia EXCELLENT. Haa very ef- Foe his pay grede, he ia EXCELLENT. Promotes 
fective knowledge, skill, and judgment. Needs ao super. morale and contidence. Effective at most times. 
vision (or routine matters but moderate auperviaion for Givea orders well. Excailent petty officer material. 
aew aituations. Does well m his own Very well qual- Pride in uniform. Military beenng. Strong instistive. 










ified lor advancement. 













For kia pay grada, he ia ABOVE AVERAGE. Good 
knowledge of rate. Skilled. Needa micimum super- 
vision for routine matters. Works well on his own for 
limited periods and details. Well quaiified for 
advencement. 


For his pay grode, he 13 ABOVE AVERAGE. Develops 
good cooperation and teamwork. Maintains good morale 
and reapect. Makes orders effective. Very good petty 
officer mstenal. Militery and woars uniform weil, 

Good iniliative. 











For hia pey grade, he is AVERAGE. Kaowa rate satis- 
factorily. Needs minimum supervision for routine work 
assignments. Quatilied for advancement. 





For his pay grade, he 18 AVERAGE, Maintaina morele 
and respect. Geta adequate resulta from hia men. Good 
petty officer matenal. Presents good bearing snd 

Has initiative. 










appearance. 





Fee his pay grede, he ia SLIGHTLY BELOW AVERAGE 
in knowledge end effectiveness. Normal supervision 
needed in almost all sesignments. Additional training 
and/or experience will qualify him {or advancement. 


Foer hia pay grade, he ia SLIGHTLY BELOW AVERAGE 
Maintaina own morale. Achieves fairresulta. Fair 
petty officer material, Good appearance moat of the 
time. 

























For his pay grade, he is BELOW AVERAGE in prol- 
ciency, ellectivenesa, and akill. Does weil when aup 
viaed bat is somewhat inadequate usliess guided. Pro- 
motion materiel oniy after additional traınıng and 

experience. 


For hie pey grede, he ia WELL BELOW AVERAGE in 

effectiveness, proficiency and siall. Barely satis- 

factory. Close supervision required. Good work offset 
by CGrequeat poor performance. 


For hia pey grade, he Is UNSATISFACTORY. Poor in 
skill and offectivenens. Competency questionable. 
Needs conetant supervision. Candidate for dierating 
unless improvement is showa. 


Foe hia puy grada, he is GROSSLY INADEQUATE. 
Incompetent in almpleat tasks. Dlarating or separation 
action in order or being taken. 


For his pay grede, he is BELOW AVERAGE. Usually 
meintazns moralje. Potential petty officer maternal. 
Gets [aw resuita at times. Faire appearence. Below 
averece initiative. 





















Foe his pay grede, he ia WELL BELOW AVERAGE, 
Morale iaia off. No inıtiauve. Seidom geta good re- 
sults. Possible petty officer material with hard work, 
Poor appearance oa many occasions. 






For his pey grede, bo is INADEQUATE. Poor morale 
No initiative or intereat in improvement Often in 

trouble. Very poor petty otficer matenal. Evades re- 
sapoasibility. Non-regulstion. Weare uniform impeoperty. 


For hia pay grade, he ia GROSSLY INADEQUATE. 
Negative moreie snd iniuetive. May Se “ringleader” 
when in trouble. Constant source of :rmtation. No 

petty officer porential Sloppy appearence. 









PREVIOUS EDITIONS ARE OBSOLETE 
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CONDUCT (Check in spece below applicabio block) 


Conduct good. Conforms to Conduct satisfactory but oc- Meets minimum standards of Conduct unastisfactory. Re 
military standarda and regula- jcesiooally lax. No court- conduct, or not more than ona pestediy commits manor nill- 
tions, No court-mertial con- martial convictions. Not more | summary Court-martisi con- tary and/or ¢ivil offeoses ot 


wictions, oon-judicial pumish- [then one non-judicial punish- victaon, of not more than 2 minor | convicted by special oe 
ment or minor civil convictions. |ment or minor civil cooviction. o IE or civil) during general court-martial. 
the pen 





COMMENTS (Tf eddittonal epace ie needed, use arwther sheet and number if page 2) 


REASON FOR AEPORTING OaTe SIGNATURE OF REPORTING SUPERIOR 
(O suuammya, (7 OTHan (Speatty) 


O rmawsrun 





RETAIN COMPLETED FORM AT THE UNIT FOR JO DAYS AFTER THE CATE OF ENTRY OF THE MARKS GPO 961-783 
IN THE SERVICE RECORO: THEN DESTROY. DO NOT FILE FORM IN THE SERVICE NECORS. 


0.3 GOVERNMENT PRINTING OFFKE: 1961 O - presos 
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APPENDIX C 


Ratings Comprising Each Enlisted Community 


Community / Category 
Category Number Ratings 


General 1 Boatswain's Mate (BM) 
Service Damage Controlman (DC) 
Dental Technician (DT) 
Electrician's Mate (EM) 
Electronics Technician (ET) 
Electronics Technician 
(Communications) (ETN) 
Hospital Corpsman (HM) 
Machinery Technician (MK) 
Photojournalist (PA) 
Musician (MU) 
Radioman (RM) 
Storekeeper (SK) 
Subsistence Specialist (SS) 
Telephone Technician (TT) 
Yeoman (YN) 


Shipboard 2 Fire Control Technician (FT) 
Gunner's Mate (GM) 
Marine Science Technician (MST) 
Quartermaster (QM) 
Radarman (RD) 
Sonar Technician (ST) 


Aviation 3 Aviation Machinist Mate (AD) 
Aviation Electrician's Mate (AE) 
Aviation Structural Mechanic (AM) 
Aviation Survivalman (ASM) 
Aviation Electronics Technician (AT) 
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APPENDIX D 


Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


As previously described a sample of 2310 sets of enlisted 
performance marks was collected from the Enlisted Assignment/ 
Data Forms (CG-4526) on file with the Central Assignment 
Control (CAC) officers in the Enlisted Personnel Assignment 
Branch of Coast Guard headquarters with the majority of non- 
rated marks being obtained from the Third Coast Guard Dis- 
trict. The "Statistical Package for the Social Sciences" 
[Ref. 29/, a computer software package available at the 
Naval Postgraduate School, was utilized for computing the 
distribution of these marks. 

In the tabular presentation of results that follows, 
several statistical terms which might be unfamiliar to the 
reader have been utilized. Kurtosis was a measure of rela- 
tive flatness or peakedness of the distribution. The kurtosis 
of a normal distribution would be zero while a positive 
kurtosis indicates that the distribution was more peaked or 
narrow than a normal distribution and a negative value 
indicates the reverse. Skewness measured the deviation 
from symmetry. The skewness of a normal distribution would 


be zero while a positive value for skewness indicates that 
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the cases were clustered more to the left of the mean with 
most of the extreme values to the right and a negative value 


indicates the reverse. 


80 





Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Paygrades E-2 through E-9 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.618 
0.042 


0.205 


3.578 
0.046 
0.214 


3.996 
0.002 
0.047 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Number of cases 
(2230 for leadership since 


= 2310 


E-2's are mot assigned a 
leadership mark) 


1.500 
4.000 
2.500 


1.500 
4.000 
2.500 


1.000 
4.000 
3.000 


Kurtosis -0.332 
Skewness -0.356 
Std Error 0.004 
Kurtosis -0.149 
Skewness -0.236 
Std Error 0.005 


Kurtosis 227.777 
Skewness -14.353 
Std Error 0.001 


the Proficiency Mark and the Leadership Mark. 


Correlation 
Coefficient 
R=0.9017 


Number of 


Cases 
N=2230 
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Level of 
Significance 
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Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Paygrade E-9 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.875 
0.016 
0.125 


3.863 
0.018 
0.135 


4.000 
0.000 
0.000 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Number of cases = 59 


0.700 
4.000 


3.300 . 


0.700 
4.000 
3.300 


0.000 
4.000 
4.000 


Kurtosis 6.980 
Skewness -2.262 
Std Error 0.016 


Kurtosis 4.157 
Skewness -1.755 
Std Error 0.018 
Kurtosis 0.000 
Skewness 0.000 


Std Error 0.000 


the Proficiency Mark and the Leadership Mark. 


Correlation 

Coefficient 

R=0.9307 
Paygrade E-8 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.838 
0.017 
0 152 


Sao 
0.016 
0.126 


4.000 
0.000 
0.000 


Number of 


Cases 
N=59 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Level of 
Significance 
p=0.001 


Number of cases = 99 


1,000 
4.000 
3.000 


0.800 
4.000 
3.000 


0.000 
4.000 
4.000 


Kurtosis 15.125 
Skewness -2.966 
Std Error 0.013 
Kurtosis 5.074 
Skewness -1.597 


Std Error 0.013 


Kurtosis 0.000 
Skewness 0.000 
Std Error 0.000 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
R=0.8690 


Cases 
N=99 


q” 


Level of 
Significance 
p=0.001 





Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Paygrade E-/ 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.79 
0.018 
0.134 


3.7&5 
0.024 
0.154 


4.000 
0.000 
0.000 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Number of cases = 301 


0.900 
4.000 
3.100 


0.900 
4.000 
3.100 


0.000 
4.000 
4.000 


Kurtosis 2.842 
Skewness -1.380 
Std Error 0.008 


Kurtosis 1.246 
Skewness -1.057 
Std Error 0.009 


Kurtosis 0.000 
Skewness 0.000 
Std Error 0.000 


the Proficiency Mark and the Leadership Mark. 


Correlation 

Coefficient 

R=0.8569 
Paygrade E-6 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.693 
0.028 
0.167 


37652 
0.031 
0.177 


4.000 
0.000 
0.009 


Number of 


Cases 
N=301 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


1.000 
4.000 
3.000 


0.800 
4.000 
3.200 


0.200 
4.000 
3.800 


Level of 
Significance 
p=0.001 


Number of cases = 544 


Kurtosis 0.685 
Skewness -0.848 
Std Error 0.007 


Kurtosis -0.435 
Skewness -0.494 
Std Error 0.008 


Kurtosis 539.002 
Skewness -23,259 
Std Error 0.000 


the Proficiency Mark and the Leadership Mark. 


Correlation 
Coefficient 
=0.8699 


Number of 


Cases 
N=544 
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Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Paygrade E-5 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 

Variance 

Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.614 
0.027 
0.164 


3:552 
0.029 
0.169 


3.995 
0.004 
0.061 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


0.900 
&.000 
3.100 


0.800 
3.900 
3.100 


1.000 
4.000 
3.000 


Number of cases = 472 


Kurtosis -0.242 
Skewness -0.409 
Std Error 0.008 
Kurtosis -0.364 
Skewness -0,179 


Std Error 0.008 


Kurtosis 191.543 
Skewness -13.464 
Std Error 0.003 


the Proficiency Mark and the Leadership Mark. 


Correlation 

Coefficient 

R=0,8362 
Paygrade E-4 


Proficiency Mark 
Mean 
Variance 


3.488 
0.027 


Std Deviation 0.165 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.427 
0.028 
0.166 


0.063 


Number of 


Cases 
N=472 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


0.800 
4.000 
3.200 


Level of 
Significance 
p=0.001 


Number of cases = 675 


Kurtosis 0.276 
Skewness 0.039 
Std Error 0.006 


Kurtosis 1.965 
Skewness -0.069 
Std Error 0.006 


Kurtosis 106.119 
Skewness -9.995 
Std Error 0.002 


the Proficiency Mark and the Leadership Mark. 


Correlation 
Coefficient 
R=0.8081 


Number of 


Cases 
N=675 
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Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Paygrade E-3 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean ` 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.430 
0.035 
0.186 


3.991 
0.003 
0.058 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Number of cases = 80 


1.300 
3.800 
2.500 


1.300 
3.800 
2.500 


0.500 
4.000 
3.500 


Kurtosis 6.109 
Skewness -1.373 
Std Error 0.021 
Kurtosis 6.749 
Skewness -1.513 
Std Error 0.021 
Kurtosis 64.072 
Skewness -7.920 
Std Error 0.006 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
R=0.8606 


Paygrade E-2 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


3.356 
0.013 
0.116 


Leadership Mark - NA 


Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.986 
0.004 
0.063 


Cases 
N=80 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Level of 
Significance 
p=0.001 


Number of cases = 80 


0.600 
3.700 
3.100 


0.500 
4.000 
3.500 


Kurtosis 1.905 
Skewness 1.205 
Std Error 0.013 
Kurtosis 
Skewness 

Std Error 
Kurtosis 43.259 
Skewness -6.267 


Std Error 0.007 


the Proficiency Mark and the Leadership Mark cannot be 
computed for paygrade E-2 since no leadership marks are 


assigned. 
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Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Category 1, Paygrade E-9 


Proficiency Mark 


Mean 3.868 

Variance 0.017 

Std Deviation 0.130 
Leadership Mark 

Mean 3.855 

Variance 0.019 

Std Deviation 0.138 
Conduct Mark 

Mean 4.000 

Variance 0.000 

Std Deviation 0.000 


Pearson Correlation Coefficient for Intercorrelation between 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Number of cases = 47 


0.700 
4.000 
3.300 


0.700 
4.000 
3.300 


0.000 
4.000 
4.000 


Kurtosis 6.846 
Skewness -2.246 
Std Error 0.019 


Kurtosis 4.480 
Skewness -1.817 
Std Error 0.020 


Kurtosis 0.000 
Skewness 0.000 
Std Error 0.000 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
R=0.9457 


Category 1, Paygrade E-8 


Proficiency Mark 


Mean 34928 

Variance 0.021 

Std Deviation 0.145 
Leadership Mark 

Mean 3.807 

Variance 0.019 

Std Deviation 0.140 
Conduct Mark 

Mean 4.000 

Variance 0.000 


Std Deviation 0.000 


Pearson Correlation Coefficient for Intercorrelation between 


Cases 
N=47 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Level of 
Significance 
p=0.001 


Number of cases = 67 


1.000 
4.000 
3.000 


0.800 
4.000 
3.200 


0.000 
4.000 
4.000 


Kurtosis 14.339 
Skewness -3.093 
Std Error 60.018 
Kurtosis 4.462 
Skewness -1.615 


Std Error 0.017 


Kurtosis 0.000 
Skewness 0.000 
Std Error 0.000 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
R=0.8846 


Cases 
N=67 
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Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Category 1, Paygrade E-/ 


Proficiency Mark 


Mean 32774 

Variance 0.020 

Std Deviation 0.140 
Leadership Mark 

Mean 5732 

Variance 0.025 

Std Deviation 0.157 
Conduct Mark 

Mean &.000 

Variance 0.000 


Std Deviation 0.000 


Pearson Correlation Coefficient for Intercorrelation between 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Number of cases = 208 


0.900 
4.000 
3.100 


0.900 
4.000 
3.100 


Kurtosis 32235 
Skewness -1.525 
Std Error 0.010 


Kurtosis 1.569 
Skewness -1,188 
Std Error 60,011 


Kurtosis 0.000 
Skewness 0.000 
Std Error 0.000 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
R=0.8790 


Category 1, Paygrade E-6 


Proficiency Mark 


Mean 3.677 

Variance 0.028 

Std Deviation 0.167 
Leadership Mark 

Mean 3.636 

Variance 0.031 

Std Deviation 0.175 
Conduct Mark 

Mean 4.000 

Variance 0.000 


Std Deviation 0.010 


Pearson Correlation Coefficient for Intercorrelation between 


Cases 
N=208 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Level of 
Significance 
p=0.001 


Number of cases = 429 


1.000 
4.000 
3.000 


0.800 
4.000 
3.200 


0.200 
4.000 
3.800 


Kurtosis 0.632 
Skewness -0.849 
Std Error 0.008 


Kurtosis -0.507 
Skewness -0.488 
Std Error 0.008 


Kurtosis 424.002 
Skewness -20.640 
Std Error 0.000 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
=),8694 


Cases 
N=429 
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Level of 
Significance 
p=0.001 





Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Category 1, Paygrade E-5 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.607 
0.027 
0.166 


3.545 
0.029 
0.170 


3.998 
0.001 
0.038 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


0.900 
4.000 
3.100 


0.800 
3.900 
3.100 


0.700 
4.000 
3.300 


Number of cases = 


Kurtosis 
Skewness 
Std Error 


Kurtosis 
Skewness 
Std Error 


346 


=0.201 
-0.402 


0.009 


-0,375 
-0.201 


0.009 


Kurtosis 327.496 
Skewness -18.016 


Std Error 


the Proficiency Mark and the Leadership Marks. 
Number of 


Correlation 
Coefficient 
R=0.8346 


Category 1, Paygrade E-4 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.481 
0.028 
0.166 


3.420 
0.028 
0.166 


3: 992 
0.004 
0.061 


Cases 
N=346 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


1.100 
4.000 
2.900 


1.400 
3.900 
2.500 


0.700 
&.000 
3.300 


Level of 


0.002 


Significance 


p=0.001 


Kurtosis 
Skewness 
Std Error 


Kurtosis 
Skewness 
Std Error 


Kurtosis 
Skewness 
Std Error 


the Proficiency Mark and the Leadership Mark. 


Correlation 
Coefficient 
R=0.8209 


Number of 


Cases 
N=537 
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Level of 


Number of cases = 537 


0.448 
0.068 
0.007 


2.432 


-0.143 


0.007 


97.136 
-9.540 


0.003 


Significance 


p=0.001 





Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Category 2, Paygrade E-9 


Proficiency Mark 


Mean 3.883 

Variance 0.022 

Std Deviation 0.147 
Leadership Mark 

Mean 3.883 

Variance 0.022 

Std Deviation 0.147 
Conduct Mark 

Mean 4.000 

Variance 0.000 


Std Deviation 0.000 


Pearson Correlation Coefficient for Intercorrelation between 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Number of cases = 


0.400 
4.000 
3.600 


0.400 
4.000 
3.600 


0.000 
4.000 
4.000 


63 


Kurtosis 0.484 
Skewness -1.343 
Std Error 0.060 
Kurtosis 0.484 
Skewness -1.343 


Std Brror 0% 


Kurtosis 0. 
Skewness 0 
Std Error 0. 


the Proficiency Mark and the Leadership Mark. 


Correlation 
Coefficient 
R=1.000 


Catesory 2, Paygrade E-3 


Proficiency Mark 


Mean 3.820 

Variance 0.020 

Std Deviation 0.140 
Leadership Mark 

Mean 3.790 

Variance 0.010 

Std Deviation 0.099 
Conduct Mark 

Mean 4.000 

Variance 0.000 

Std Deviation 0.000 


Number of 


Cases 
N=6 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Number of cases = 


0.400 
4.000 
3.600 


0,000 
4.000 
4.000 


Level of 


Significance 


p=0.001 


10° 


060 


000 


. 000 


000 


Kurtosis -1.325 
Skewness -0.113 
Std Error 0.044 
Kurtosis -1,846 
Skewness 0.200 
Std Error 0.031 
Kurtosis 0.000 
Skewness 0.000 
Std Error 0.000 


Pearson Correlation Coefficient for Intercorrelation between 
the Proficiency Mark and the Leadership Mar. 


Correlation Number of Level of 
Coefficient Cases Significance 
R=0.8149 N=10 p=0.002 


Since the number of cases in this cross-section of the 
sample was less than thirty, the confidence that these results 
accurately represent the total population in this cross-section 


is suspect. 
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Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Number of cases = 45 


Category 2, Paygrade E-7 


Proficiency Mark 


Mean 3.751 Range 0.500 Kurtosis -0.713 

Variance 0.019 Maximum 4.000 Skewness -0.288 

Std Deviation 0.138 Minimum 3.500 Std Error 0.021 
Leadership Mark 

Mean 3.696 Range 0.700 Kurtosis -0.552 

Variance 0.028 Maximum 4.000 Skewness -0.228 

Std Deviation 0.166 Minimum 3.300 Std Error 0.025 
Conduct Mark 

Mean 4.000 Range 0.000 Kurtosis 0.000 

Variance 0.000 Maximum 4.000 Skewness 0.000 

Std Deviation 0.000 Minimum 4.000 Std Error 0.000 


Pearson Correlation Coefficient for Intercorrelation between 
the Proficiency Mark and the Leadership Mark. 


Correlation Number of Level of 
Coefficient Cases Significance 
R=0, 7943 N=45 p=0.001 


Number of cases = 52 


Category 2, Paygrade E-6 


Proficiency Mark 


Mean 3.706 Range 0.700 Kurtosis 1.219 

Variance 0.021 Maximum 4.000 Skewness -0.948 

Std Deviation 0.143 Minimum 3.300 Std Error 0.020 
Leadership Mark 

Mean 3.675 Range 0.700 Kurtosis -0.340 

Variance 0.024 Maximum 4.000 Skewness -0.348 

Std Deviation 0.155 Minimum 3.300 Std Error 702027 
Conduct Mark 

Mean 4.000 Range 0.000 Kurtosis 0.000 

Variance 0.000 Maximum 4.000 Skewness 0.000 

Std Deviation 0.000 Minimum 4.000 Std Error 0.000 


Pearson Correlation Coefficient for Intercorrelation between 


the Proficiency Mark and the Leadership Mark. 


Correlation Number of Level of 
Coefficient Cases Significance 
=0.7591 N=52 p=0.001 


90 





Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Category_2, Paygrade E-5 Number of cases = 54 


Proficiency Mark 


Mean 3.606 Range 0.600 Kurtosis -0.937 

Variance 0.034 Maximum 3.900 Skewness -0.193 

Std Deviation 0.184 Minimum 3.300 Std Error 0.025 
Leadership Mark 

Mean 3.535 Range 0.700 Kurtosis -0.518 

Variance 0.033 Maximum 3.900 Skewness 0.262 

Std Deviation 0.180 Minimum 3.200 Std Error 0.025 
Conduct Mark 

Mean 3.978 Range 1.000 Kurtosis 47.027 

Variance 0.019 Maximum 4.000 Skewness -6.941 

Std Deviation 0.137 Minimum 3.000 Std Error 0.019 


Pearson Correlation Coefficient for Intercorrelation between 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
R=0.8428 


Cases 
N=54 


Level of 
Significance 
p=0.001 


Number of cases = 72 


Category 2, Paygrade E-4 


Proficiency Mark 


Mean 3.544 Range 0.600 Kurtosis -0.833 

Variance 0.024 Maximum 3.800 Skewness -0.164 

Std Deviation 0.154 Minimum 3.200 Std Error 0.018 
Leadership Mark 

Mean 3.453 Range 0.800 Kurtosis -0.153 

Variance 0.028 Maximum 3.800 Skewness 0.076 

Std Deviation 0.169 Minimum 3.000 Std Error 0.020 
Conduct Mark 

Mean 3.986 Range 0.800 Kurtosis 62.884 

Variance 0.009 Maximum 4.000 Skewness -7.955 

Std Deviation 0.095 Minimum 3.200 Std Error 0.011 


Pearson Correlation Coefficient for Intercorrelation between 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
R=0.7341 


Cases 
N=72 
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Level of 
Significance 
p=0.001 


Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Category 3, Paygrade E-9 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.917 
0.002 
0.041 


3.900 
0.012 
0.110 


4.000 
0.000 
0.000 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Number of cases = 


0.100 
4.000 
3.900 


0.300 
4.000 
3.700 


0.000 
4.000 
4.000 


63 
Kurtosis 1.200 
Skewness -1.000 


Std Error 0,045 


Kurtosis -0.000 
Skewness -1.000 
Std Error 0.045 


Kurtosis 0.000 
Skewness 0.000 
Std Error 0.000 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
R=0.4474 


Category 3, Paygrade E-8 


Proficiency Mark 
Mean 
Variance 
Std Deviation 


Leadership Mark 
Mean 
Variance 
Std Deviation 


Conduct Mark 
Mean 
Variance 
Std Deviation 


Pearson Correlation Coefficient for Intercorrelation between 


3.877 
0.005 
0.069 


3.836 
0.007 
0.085 


4.000 
0.000 
0.000 


Cases 
N = 6 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Level of 
Significance 
p=0.187 


Number of cases = 223 


0.300 
4.000 
3.700 


0.400 
4.000 
3.600 


0.000 
4.000 
4.000 


Kurtosis 0.671 
Skewness -0.608 
Std Error 0.015 


Kurtosis 1.201 
Skewness -0.762 
Std Error 0.013 
Kurtosis 0.000 
Skewness 0.000 


Std Error 0.000 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
R=0.8055 


Cases 
N=22 


Level of 
Significance 
p=0.001 


Since the number of cases in this cross-section of the 


sample was less than thirty, the confidence that these results 


accurately represent the total population in this cross- 
section is suspect. 
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Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Number of cases = 48 


Category 3, Paygrade E-7 


Proficiency Mark 


Mean 3.827 Range 0.400 Kurtosis 0.196 

Variance. 0.008 Maximum 4.000 Skewness -0.747 

Std Deviation 0.087 Minimum 3.600 Std Error 0.013 
Leadership Mark 

Mean 3.802 Range 0.400 Kurtosis -0.788 

Variance 0.010 Maximum 4.000 Skewness -0.405 

Std Deviation 0.102 Minimum 3.600 Std Error 0.015 
Conduct Mark 

Mean 4.000 Range 0.000 Kurtosis 0.000 

Variance 0.000 Maximum 4.000 Skewness 0.000 

Std Deviation 0.000 Minimum 4.000 Std Error 0.000 


Pearson Correlation Coefficient for Intercorrelation between 
the Proficiency Mark and the Leadership Mark. 


Correlation Number of Level of 
Coefficient Cases Significance 
=0.7134 N=48 p=0.001 


Category 3, Paygrade E-6 


Proficiency Mark 


Number of cases = 63 


Mean 3.790 Range 0.800 Kurtosis 1.896 

Variance 0.024 Maximum 4.000 Skewness -1.272 

Std Deviation 0.156 Minimum 3.200 Std Error 0.020 
Leadership Mark 

Mean 3.743 Range 0.800 Kurtosis 0.374 

Variance 0.032 Maximum 4.000 Skewness -0.938 

Std Deviation 0.178 Minimum 3.200 Std Error 0.022 
Conduct Mark 

Mean 4.000 Range 0.000 Kurtosis 0.000 

Variance 0.000 Maximum 4.000 Skewness 0.000 

Std Deviation 0.000 Minimum 4.000 Std Error 0.000 


Pearson Correlation Coefficient for Intercorrelation between 


the Proficiency Mark and the Leadership Mark. 


Correlation Number of Level of 
Coefficient Cases Significance 
R=0.8997 N=63 p=0.001 
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Analysis of Coast Guard-wide Sample of Performance 
Marks for 31 December 1975 


Number of cases - 72 


Category 3, Paygrade E-5 


Proficiency Mark 


Mean 3.654 Range 0.600 Kurtosis 0.036 

Variance 0.019 Maximum 3.900 Skewness -0.441 

Std Deviation 0.136 Minimum 3.300 Std Error 0.016 
Leadership Mark 

Mean 3.599 Range 0.700 Kurtosis 0.067 

Variance 0.023 Maximum 3.900 Skewness -0.350 

Std Deviation 0.151 Minimum 3.200 Std Error 0.018 
Conduct Mark 

Mean 3.993 Range 0.500 Kurtosis 67.014 

Variance 0.003 Maximum 4.000 Skewness -8.307 

Std Deviation 0.059 Minimum 3.500 Std Error 0.007 


Pearson Correlation Coefficient for Intercorrelation between 
the Proficiency Mark and the Leadership Mark. 


Correlation Number of Level of 
Coefficient Cases Significance 
R=0.8273 N=72 p=0.001 


Number of cases = 66 


Category 3, Paygrade E-4 


Proficiency Mark 


Mean 3.480 Range 0.800 Kurtosis 0.012 

Variance 0.024 Maximum 3.900 Skewness 0.105 

Std Deviation 0.154 Minimum 3.100 Std Error 0.019 
Leadership Mark 

Mean 3.459 Range 0.800 Kurtosis 0.078 

Variance 0.026 Maximum 3.900 Skewness 0.418 

Std Deviation 0.162 Minimum 3.100 Std Error 0.020 
Conduct Mark 

Mean 4.000 Range 0.000 Kurtosis 0.000 

Variance 0.000 Maximum 4.000 Skewness 0.000 

Std Deviation 0.000 Minimum 4.000 Std Error 0.000 


Pearson Correlation Coefficient for Intercorrelation between 


the Proficiency Mark and the Leadership Mark. 
Number of 


Correlation 
Coefficient 
R=0.8129 


Cases 
N=66 
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APPENDIX E 


Analysis of the Servicewide Examination Data 


from March 1976 Servicewides 


To compute the actual weightings that each of the five 
factors contribute to the final multiple for advancement, a 
series of multiple regressions were computed on the March 
1976 servicewide ion data obtained from the Coast 
Guard Institute utilizing the "Statistical Package for the 
Social Sciences.' The actual contributions were determined 
from the amount of variance in the final multiple produced 
by each factor as determined by the change in the squared 
value of the multiple regression coefficient. Several 
regressions were performed, first by aggregating all pay- 
grades and then by each individual paygrade from E-2 to 
E-8 who had competed for advancement to paygrades E-4 to 
E-9 respectively. 

One shortcoming with this methodology was that there was 
some intercorrelation between the factors. However, these 
intercorrelations were very small except between the time 
in service factor and the time in paygrade in present rating 
factor. Consequently, the actual contribution made by the 
performance factor, as well as the servicewide examination 


and awards factors, have been considered reasonably accurate. 


95 





The tabular display of results that follows employed 
the following abbreviations that were unique to the study 


and are not commonly accepted statistical abbreviations: 


Abbreviation Meaning 
SWE Servicewide examination factor 
PERF Performance factor 
TIS Time in Service factor 
TIR Time in paygrade in present 


rating factor 


FINALMUL Final Multiple 
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Performance Mark Distributions Computed From 


DEPENDIXTE 


March 1976 Servicewide Examination Data 


Paygrades E-3 through E-8 


Mean 
Variance 
Std Deviation 


Paygrade E-8 
Mean 


Variance 
Std Deviation 


Paygrade E-/ 


Mean 
Variance 
Std Deviation 


Paygrade E-6 
Mean 


Variance 
Std Deviation 


Paygrade E-5 
Mean 


Variance 
Std Deviation 


Paygrade E-4 


Mean 
Variance 
Std Deviation 


Paygrade E-3 


Mean 
Variance 
Std Deviation 


3.624 
0.028 
0.166 


3.927 
0.009 
0.094 


3. 751 
0.015 
0.121 


3.707 
0.018 
0.136 


3.638 
0.020 
0.141 


3.955 
0.021 
0.145 


3.485 
0.019 
0.138 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


Range 
Maximum 
Minimum 


104 


Number of cases 
0.770 Kurtosis 
4.000 Skewness 
3.230 Std Error 

Number of cases 
0.440 Kurtosis 
4.000 Skewness 
3.560 Std Error 

Number of cases 
0.700 Kurtosis 
3.960 Skewness 
3.260 Std Error 

Number of cases 
0.760 Kurtosis 
4.000 Skewness 
3.240 Std Error 

Number of cases 
0.720 Kurtosis 
3.950 Skewness 
3.230 Std Error 

Number of cases 
0.700 Kurtosis 
4.000 Skewness 
3.300 Std Error 

Number of cases 
0.650 Kurtosis 
3.950 Skewness 
3.300 Std Error 





APPENDIX G 


Coast Guarp ENLISTED PERFORMANCE SIGNIFICANT INCIDENT Form 


Duties 


Objectives for the Period 





Special Projects 


Training Accomplishments 
Supervisor's Name and Rate 
Division Officer's Name and Rank 


End of Period Comments 


Supervisor 
Division Officer 


Department Head 


Executive Officer 
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Coast GUARD ENLISTED PERFORMANCE SIGNIFICANT INCIDENT Form 


Performance of Duties 


Positive Incidents Date Negative Incidents Date 


1. (Abstract term derived using the Echo Technique given) 








10. 
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Coast GUARD ENLISTED PERFORMANCE SIGNIFICANT INCIDENT FoRM 


Personal Qualities 





Positive Incidents Date Negative Incidents Date 


1. (Abstract term derived using the Echo Technique given) 





10. 
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Coast GUARD ENLISTED PERFORMANCE SIGNIFICANT INCIDENT Form 


Record of Counseling 


Initial Session: Date: 


Areas Discussed: 


Objectives for Period: 


Duties Assigned: 


Informal Sessions: Date: 


Areas 


Date: 


Areas 


Date: 


Areas 


Date: 


Areas 


End of Period Session: 
Date: 


Areas 


Plans 


Supervisor's Initials 
Ratee's Initials 


Supervisor's Initials 
Ratee's Initials 
Discussed: 


Supervisor's Initials 
Ratee's Initials 
Discussed: 


Supervisor's Initials 
Ratee's Initials 
Discussed: 


Supervisor's Initials 
Ratee's Initials 
Discussed: 


Supervisor's Initials 

Ratee's Initials 

Div. Off. Initials 
Discussed: 


for Improvement: 
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APPENDIX H 


Coast GUARD ENLISTED PERFORMANCE EVALUATION FORM 


n 


Description of Duties 








Training Accomplishments 


Performance of Duties N/09 3071655413121 


Overall 


EEE BER Eee 
Desired Distribution 11%] 4%10%20%30420%10% 44 1% 
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Coast Guarp ENLISTED PERFORMANCE EVALUATION FORM 
Conduct Place conduct mark in appropriate block 


Cooduct good. Conforma to Coaduct satisfactory but oc- Meets minimum standards of Conduct unsatisfactory. Re- 
military standards and regula- casionally lex. No court- conduct, or not more than one _ pestediy commits minor mili- 
thona. No court-martial con- martial coovictions. Not more summary court-martial con- tary and/or civil offenses or 
sictions, non-jadicial punish- than one noo-judicial punish- viction, or not more than 2 minor convicted by special oe 
ment or minor civil convictions. ment or minor civil couviction. ra (NJP or civil) during general court-mastial. 





Comments 





Future Assignment Recommendation 
Recommended |Recommended| Recommended 


PA PA 
Instructor Duty See ISO o 
_ AA 


Public Interaction 
Recruiting, Boating Safety, Intellegence 


Independent Dut 





Commanding Officer's Hame and Rank 


Signature Date 
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APPENDIX I 


The Echo Technique 


For an accurate assessment of an individual's performance 
to occur, the attention of the first-line supervisor must 
be directed to those specific actions that are associated 
with success or failure in the work environment. The Echo 
Technique used to identify these actions has the advantage 
over other methodologies of providing these specific examples 
while in the process of identifying the evaluation headings 
for the forms to be used in the proposed evaluation system. 
Since the Echo Technique is accomplished using a sample of 
individuals taken from the personnel that will eventually 
use the constructed form, an additional advantage of using 
current Coast Guard jargon is also derived. 

The evaluation headings derived using this methodology 
will be abstractions under the general heading of "Performance 
of Duties" and "Personal Qualities." Examples of these eval- 
uation headings might be phrases or terms such as "Training 
of Subordinates" or "Planning and Scheduling of Work" for 
the performance section, and "Initiative" or "Judgment" for 
the personal qualities section. These abstract terms in 


themselves do not lend themselves to objective evaluation 
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of subordinates. Specific examples of observable actions 
must be given to the first-line supervisor to aid him in the 
evaluation of his personnel. These examples are to be placed 
on the Significant Incident Form to direct the supervisor 

to the specific actions that should be looked for during 

his daily observations. This approach will lead to a more 


objective and meaningful system of evaluations. 


A. SAMPLING METHODOLOGY 
l. General Comments 
For all paygrades the personnel selected are to be 
chosen on a stratified random sampling basis. Stratifica- 
tion is to be done to insure that representation from the 
general service, shipboard, and aviation communities is 
approximately equal to the proportion found in the popula- 
tion itself. The individuals selected are to be randomly 
selected, avoiding sampling based on convenience. 
2. The Sample and Initial Procedure 
a. For Paygrades E-6 through E-9 
Forty individuals will be selected for each pay- 
grade, twenty are to be in the paygrade being considered, 
ten from the two paygrades below, and ten from the immediate 
supervisors of the paygrade. These individuals will list 


ten good and ten bad actions from their Coast Guard 
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experience that are indicative of performance of duty and 
personal qualities. The end result of this process will be 
800 examples, 400 good and 400 bad, for both performance of 
duty and personal qualities for each of the four paygrades. 
b. For Paygrades E-2 through E-5 

Forty individuals will be selected for each pay- 
grade, twenty-five are to be in the paygrade being Baus ideved 
and fifteen are to be immediate supervisors of the paygrade. 
These individuals will list ten good and ten bad actions from 
their Genet Guard experience that are indicative of perform- 
ance of duty only. The end result of this process will be 
800 examples, 400 good and 400 bad, for the performance of 


duty for each paygrade. 


B. CLASSIFICATION OF ''PERFORMANCE OF DUTIES” 

Eight individuals, randomly selected from the initial 
forty, will serve as classifiers for each paygrade. The 
800 examples will be divided randomly among the eight classi- 
fiers (100 per classifier) who will individually compile or 
group cards together that appear to them to refer to the 
same attribute. The classifiers will be divided into two 
teams and meet in a common location. One classifier will 
read his or her groups and the other team members will add 


their cards to the reader's as they feel appropriate. 
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Additional card groupings are formed as necessary. The 
team will then review their initial classification, further 
refining the classification by reassigning cards by team 
consensus, and then the team will choose a descriptive term 
for each group of examples classified. The results of the 
two teams will be compared and final classification and 
naming of the groups will be done by the eight person team. 
The two team approach described above was chosen to reduce 
the effect of individual differences, avoid fatigue, and to 


allow for measurement of interclassifier reliability. 


C. CLASSIFICATION OF "PERSONAL QUALITIES" 

The same general procedures will be utilized for the 
classification of''Personal Qualities’ examples as was used 
for the classification of 'Performance of Duties" examples. 
An exception to this will be that eight ecke per pay- 
grade from the top four paygrades (total of 32 classifiers) 
will be randomly chosen to classify 100 examples each as 


individuals, then as eight person teans. 


D. OUTPUT OF THE ECHO TECHNIQUE 

The final output of the Echo Technique described above 
is the production of terms in the current jargon of the 
Coast Guard that group together observable actions that are 


indicative of performance of duty standards and personal 


114 





qualities that should be evaluated. These terms will be 
used as evaluation headings for both the Significant Inci- 
dent Form and the Enlisted Performance Evaluation Form. 
"Performance of Duty" headings will vary with paygrade, but 
if the headings are similar, as may be expected for paygrades 
with similar duties, a composite form for these paygrades 
may be used. ''Personal Qualities' evaluation headings will 


be the same for all paygrades and therefore on all forms. 
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